-- Logs begin at Sun 2022-09-18 00:10:26 UTC, end at Sun 2022-09-18 01:09:33 UTC. -- Sep 18 00:41:14.204562 dv-osbrick-master-4-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Sep 18 00:41:14.213354 dv-osbrick-master-4-iscsi devstack@keystone.service[81560]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 18 00:41:14.215381 dv-osbrick-master-4-iscsi devstack@keystone.service[81560]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Sep 18 00:41:14 2022] *** Sep 18 00:41:14.215381 dv-osbrick-master-4-iscsi devstack@keystone.service[81560]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 18 00:41:14.215381 dv-osbrick-master-4-iscsi devstack@keystone.service[81560]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 18 00:41:14.215381 dv-osbrick-master-4-iscsi devstack@keystone.service[81560]: nodename: dv-osbrick-master-4-iscsi Sep 18 00:41:14.215381 dv-osbrick-master-4-iscsi devstack@keystone.service[81560]: machine: x86_64 Sep 18 00:41:14.215381 dv-osbrick-master-4-iscsi devstack@keystone.service[81560]: clock source: unix Sep 18 00:41:14.215381 dv-osbrick-master-4-iscsi devstack@keystone.service[81560]: pcre jit disabled Sep 18 00:41:14.215381 dv-osbrick-master-4-iscsi devstack@keystone.service[81560]: detected number of CPU cores: 4 Sep 18 00:41:14.215381 dv-osbrick-master-4-iscsi devstack@keystone.service[81560]: current working directory: / Sep 18 00:41:14.215381 dv-osbrick-master-4-iscsi devstack@keystone.service[81560]: detected binary path: /usr/bin/uwsgi-core Sep 18 00:41:14.215972 dv-osbrick-master-4-iscsi devstack@keystone.service[81560]: your processes number limit is 47680 Sep 18 00:41:14.215972 dv-osbrick-master-4-iscsi devstack@keystone.service[81560]: your memory page size is 4096 bytes Sep 18 00:41:14.215972 dv-osbrick-master-4-iscsi devstack@keystone.service[81560]: detected max file descriptor number: 2048 Sep 18 00:41:14.215972 dv-osbrick-master-4-iscsi devstack@keystone.service[81560]: lock engine: pthread robust mutexes Sep 18 00:41:14.215972 dv-osbrick-master-4-iscsi devstack@keystone.service[81560]: thunder lock: enabled Sep 18 00:41:14.215972 dv-osbrick-master-4-iscsi devstack@keystone.service[81560]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 18 00:41:14.215972 dv-osbrick-master-4-iscsi devstack@keystone.service[81560]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 18 00:41:14.255935 dv-osbrick-master-4-iscsi devstack@keystone.service[81560]: Python main interpreter initialized at 0x5565957999c0 Sep 18 00:41:14.255935 dv-osbrick-master-4-iscsi devstack@keystone.service[81560]: python threads support enabled Sep 18 00:41:14.255935 dv-osbrick-master-4-iscsi devstack@keystone.service[81560]: your server socket listen backlog is limited to 100 connections Sep 18 00:41:14.255935 dv-osbrick-master-4-iscsi devstack@keystone.service[81560]: your mercy for graceful operations on workers is 90 seconds Sep 18 00:41:14.256330 dv-osbrick-master-4-iscsi devstack@keystone.service[81560]: mapped 403077 bytes (393 KB) for 2 cores Sep 18 00:41:14.256409 dv-osbrick-master-4-iscsi devstack@keystone.service[81560]: *** Operational MODE: preforking *** Sep 18 00:41:14.256650 dv-osbrick-master-4-iscsi devstack@keystone.service[81560]: *** uWSGI is running in multiple interpreter mode *** Sep 18 00:41:14.256650 dv-osbrick-master-4-iscsi devstack@keystone.service[81560]: spawned uWSGI master process (pid: 81560) Sep 18 00:41:14.256865 dv-osbrick-master-4-iscsi systemd[1]: Started Devstack devstack@keystone.service. Sep 18 00:41:14.257996 dv-osbrick-master-4-iscsi devstack@keystone.service[81560]: spawned uWSGI worker 1 (pid: 81571, cores: 1) Sep 18 00:41:14.257996 dv-osbrick-master-4-iscsi devstack@keystone.service[81560]: spawned uWSGI worker 2 (pid: 81572, cores: 1) Sep 18 00:41:14.257996 dv-osbrick-master-4-iscsi devstack@keystone.service[81560]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 18 00:41:18.604539 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 18 00:41:18.604539 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: from cryptography.utils import int_from_bytes Sep 18 00:41:18.605330 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 18 00:41:18.605330 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: from cryptography.utils import int_from_bytes Sep 18 00:41:18.610577 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 18 00:41:18.610577 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: from cryptography.utils import int_from_bytes Sep 18 00:41:18.611027 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 18 00:41:18.611027 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: from cryptography.utils import int_from_bytes Sep 18 00:41:18.656001 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 18 00:41:18.656184 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 18 00:41:18.656377 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] command line args: [] {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 18 00:41:18.656656 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 18 00:41:18.656836 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] ================================================================================ {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 18 00:41:18.657092 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] admin_token = **** {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.657341 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] config_dir = [] {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.657531 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.657715 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] config_source = [] {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.657895 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] debug = True {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.658095 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.659336 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.659336 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.659456 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 18 00:41:18.659516 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.659576 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 18 00:41:18.659643 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.659704 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] command line args: [] {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 18 00:41:18.659765 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] list_limit = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.659820 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 18 00:41:18.659880 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] log_config_append = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.659970 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] ================================================================================ {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 18 00:41:18.660043 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.660043 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] log_dir = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.660150 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] admin_token = **** {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.660210 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] log_file = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.660266 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] config_dir = [] {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.660326 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.660388 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.660445 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] config_source = [] {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.660499 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.660684 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] debug = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.660765 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.660834 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.660969 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.661086 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.661165 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.661282 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.661355 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.661480 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.661559 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.661700 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.661782 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.661937 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] list_limit = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.662016 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.662150 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] log_config_append = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.662241 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.662316 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.662431 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.662542 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] log_dir = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.662660 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] log_file = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.662852 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.662971 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.663088 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.663205 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.663329 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.663448 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.663570 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.663690 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.663810 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.663941 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.15/identity {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.664068 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.664191 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] publish_errors = False {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.664303 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.664421 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.664537 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.664658 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.664775 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.664886 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.664995 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.665104 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.665211 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.665329 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.665441 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.665561 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] standard_threads = False {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.665679 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.665790 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.666160 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.666279 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.666279 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.666500 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.666633 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] use_journal = False {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.666633 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] use_json = False {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.666853 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] use_stderr = False {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.666968 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.15/identity {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.667080 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] use_syslog = False {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.667197 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] publish_errors = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.667314 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.667431 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.667549 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.667667 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.667667 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.667941 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.668063 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.668175 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.668292 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.668403 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.668519 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] standard_threads = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.668645 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.668758 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.668874 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.668985 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.669095 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.669211 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.669211 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] use_journal = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.669428 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.669545 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] use_json = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.669657 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.669766 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] use_stderr = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.669876 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.669993 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] use_syslog = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.669993 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 00:41:18.670209 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.670209 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.670416 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.670526 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.670645 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.670757 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.670867 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.670977 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.671087 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.671226 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.671355 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.671467 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.671578 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.671730 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.671852 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.671852 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.672088 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.672212 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.672326 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.672436 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.672546 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.672656 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.672776 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.672888 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.672998 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.673108 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.673218 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.673328 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.673519 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.673633 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.673744 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.673862 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.673980 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.674099 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.674211 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.674328 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.674328 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.674536 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.674647 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.674764 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.674877 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.674987 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.675097 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.675206 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.675316 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.675437 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.675553 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.675669 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.675787 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.675954 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.676069 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.676190 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.676304 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.676414 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.676524 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.676634 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.676744 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.676866 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.676979 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.677090 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.677200 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.677315 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.677426 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.677544 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.677656 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.677767 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.677877 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.677988 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.678104 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.678223 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.678832 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.678951 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.679070 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.679181 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.679292 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.679477 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.679590 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.679701 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.679817 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.679942 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.680064 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.680186 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.680303 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.680414 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.680524 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.680634 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.680744 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.680865 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.680977 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.681072 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.681166 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.681266 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.681360 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.681461 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.681555 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.681656 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.681788 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.681886 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.681986 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.682089 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.682202 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.682303 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.682450 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.682566 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.682686 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.682798 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.682913 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.683033 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.683146 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.683258 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.683369 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.683487 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.683599 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.683709 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.683874 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.684020 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.684149 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.684270 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.684398 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.684502 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.684612 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.684724 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.684834 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.684946 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.685067 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.685181 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.685181 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.685408 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.685524 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.685636 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.685636 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.685863 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.685974 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.686085 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.686195 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.686302 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.686302 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.686521 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.686623 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.686733 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.686845 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.686956 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.687075 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.687187 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.687305 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.687418 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.687529 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.687640 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.687758 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.687871 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.687997 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.688109 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.688230 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.688343 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.688462 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.688576 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.688687 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.688798 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.688909 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.689019 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.689143 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.689256 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.689367 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.689477 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.689589 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.689700 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.689819 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.689931 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.690042 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.690153 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.690264 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.690374 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.690559 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.690674 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.690786 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.690896 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.691013 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.691134 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.691255 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.691375 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.691487 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.691599 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.691750 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.691880 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.692037 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.692158 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.692272 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.692384 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.692495 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.692606 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.692757 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.692911 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.693027 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.693140 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.693251 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] auth.external = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.693369 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.693489 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.693610 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.693732 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.693844 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.694505 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.694632 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.694745 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] auth.password = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.694889 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.695013 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] auth.token = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.695135 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.695261 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.695375 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.695493 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.695616 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.695730 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.695852 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.695993 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.696106 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.696218 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.696330 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] auth.external = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.696442 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.696566 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.696681 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.696793 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.696908 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] credential.caching = True {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.697020 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.697132 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.697242 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] auth.password = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.697361 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.697482 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] auth.token = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.697595 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.697708 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.697819 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.697940 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.698053 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.698171 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.698327 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.698444 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.698556 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.698677 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.698791 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.698903 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.699017 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.699136 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.699248 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.699369 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] credential.caching = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.699487 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.699600 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.699712 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.699824 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.699975 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.700107 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.700107 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.700320 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.700439 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.700550 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.700662 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.700785 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] federation.caching = True {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.700785 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.700999 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.701112 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.701224 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.701336 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.701456 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.701569 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.701680 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.701791 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.701903 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.702015 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.702136 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.702249 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.702362 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.702474 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.702585 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.702704 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.702818 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.702930 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.703042 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] federation.caching = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.703155 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.703266 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.703391 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] identity.caching = True {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.703504 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.703616 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.703728 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.703840 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.703990 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.704116 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.704233 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.704355 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.704468 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.704581 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.704693 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.704882 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.704998 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.705111 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.705223 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.705344 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.705458 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.705581 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.705695 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.705809 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.705921 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] identity.caching = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.706034 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.706146 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.706266 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.706380 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.706493 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.706612 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.706725 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.706837 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.706958 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.707071 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.707184 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.707296 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.707409 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.707522 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.707645 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.707758 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.707871 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.707998 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.708112 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.708225 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.708349 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.708464 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.708584 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.708697 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.708808 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.708920 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.709041 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.709154 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.709266 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.709377 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.709496 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.709609 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.709733 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.709846 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.709966 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.710085 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.710205 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.710317 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.710437 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.710552 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.710712 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.710830 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.711010 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.711125 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.711246 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.711472 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.711588 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.711701 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.711960 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.712082 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.712374 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.712523 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.712690 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.712806 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.712919 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.713167 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.713283 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.713423 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.713705 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.713830 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.714027 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.714150 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.714266 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.714565 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.714746 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.714866 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.715043 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.715169 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.715332 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.715485 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.715602 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.715796 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] ldap.user = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.715977 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.716109 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.716320 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.716436 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.716550 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.716840 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.716969 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.717182 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.717307 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.717422 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.717663 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.717778 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.717892 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.718124 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.718240 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.718353 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.718569 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.718686 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.718798 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.719026 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.719143 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.719281 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.719484 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.719601 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.719768 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.719959 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.720129 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.720372 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.720532 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.720655 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.720852 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.720978 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.721093 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.721302 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.721419 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.721531 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.721738 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.721863 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.722017 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.722212 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.722328 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.722502 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.722686 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.722815 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.723026 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.723151 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.723298 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.723540 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.723656 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.723779 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.724011 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.724133 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.724282 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.724449 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.user = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.724566 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.724733 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.724902 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.725020 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] resource.caching = True {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.725732 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.725919 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.726037 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.726220 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.726338 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.726474 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.726777 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.726932 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.727052 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.727246 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.727366 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.727531 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.727706 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.727824 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.728026 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] role.caching = True {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.728192 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.728313 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] role.driver = sql {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.728501 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.728617 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.728755 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.729052 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.729188 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.729305 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.729484 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.729602 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.729857 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.730009 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.730135 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.730250 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.730403 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.730668 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.730793 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.731064 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.731183 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.731469 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.731587 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.731886 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.732088 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.732372 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.732491 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.732804 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.732922 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.733251 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.733495 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.733682 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.733915 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.734129 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.734247 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.734447 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.734562 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.734752 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.734953 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.735069 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.735182 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.735441 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.735558 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.735703 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.736036 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.736163 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.736277 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.736504 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.736619 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.736748 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.736986 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.737102 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.737248 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.737405 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.737522 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.737735 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.737853 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.737965 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.738222 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.738348 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.738529 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] token.caching = True {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.738687 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.738806 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.739089 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.739245 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.739553 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.739670 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.740032 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.740176 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.740428 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.740595 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.740762 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.741463 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.741598 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.741870 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] resource.caching = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.742014 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.742218 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.742364 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.742543 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.742762 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.742880 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.743077 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.743255 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.743379 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.743662 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.743790 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.743930 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.744162 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.744289 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.744437 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.744604 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.744722 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] database.connection = **** {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.744945 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.745062 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.745290 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.745507 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.745627 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.745809 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.745959 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.746077 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.746281 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.746397 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] role.caching = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.746510 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.746831 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] role.driver = sql {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.746992 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.747108 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.747261 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.747431 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.747720 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.747953 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.748090 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.748207 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.748459 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.748653 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.748824 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.749117 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.749246 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.749364 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.749579 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.749697 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.749811 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.749980 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 18 00:41:18.750106 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.750499 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.750965 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.751407 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.751869 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.752363 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.752830 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.753291 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.754043 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.754488 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.754958 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.755428 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.755950 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.756387 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.756861 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.757342 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.757810 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.758261 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.758708 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.759130 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.759522 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.760090 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.760483 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.760944 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.761389 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.761831 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.762271 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.762724 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] token.caching = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.763168 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.763633 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.764103 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.764587 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.765045 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.765490 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.765952 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.766416 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.766881 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.767330 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.767784 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.768256 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.768730 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.769235 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.769680 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.770138 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.770634 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.771121 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] database.connection = **** {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.771584 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.772100 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.772558 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.773008 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.773451 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.773886 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.774330 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.774767 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.775191 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.775641 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.776126 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.776571 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.777039 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.777486 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.777945 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.778386 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.778842 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.779292 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 00:41:18.779610 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 18 00:41:18.782029 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 00:41:18.782265 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 00:41:18.782629 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 00:41:18.792584 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 00:41:18.814514 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 00:41:18.814748 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 00:41:18.814980 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 00:41:18.821472 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 00:41:18.821709 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 00:41:18.823883 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 00:41:18.842748 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 00:41:18.843149 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 00:41:18.876431 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 00:41:18.881152 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 00:41:18.926372 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 00:41:18.926606 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 00:41:18.926942 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 00:41:18.927181 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 00:41:19.083211 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 00:41:19.083375 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 00:41:19.083484 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 00:41:19.083561 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 00:41:19.083652 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 00:41:19.083732 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 00:41:19.084039 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 00:41:19.084123 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 00:41:19.084196 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 00:41:19.084283 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 00:41:19.084359 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 00:41:19.084484 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 00:41:19.107569 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 00:41:19.107733 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 00:41:19.107862 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 00:41:19.108000 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 00:41:19.108072 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 00:41:19.108202 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 00:41:19.108285 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 00:41:19.108425 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 00:41:19.108527 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 00:41:19.108644 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 00:41:19.108726 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 00:41:19.108857 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 00:41:19.108937 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 00:41:19.109070 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 00:41:19.120319 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 00:41:19.120896 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 00:41:19.133229 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 00:41:19.133462 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 00:41:19.133546 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 00:41:19.133690 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 00:41:19.133772 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 00:41:19.133916 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 00:41:19.133997 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 00:41:19.134141 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 00:41:19.134240 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 00:41:19.134360 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 00:41:19.134440 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 00:41:19.134573 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 00:41:19.134652 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 00:41:19.134787 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81571) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 18 00:41:19.151850 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.152088 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 18 00:41:19.152345 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.152428 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.152561 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 18 00:41:19.152660 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 18 00:41:19.152889 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.152969 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.153098 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 18 00:41:19.153178 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.153384 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.153466 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.153654 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.153734 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.153920 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.154182 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.163516 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.163807 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.163960 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.164111 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.164250 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.164395 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.164529 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.164819 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.171702 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 00:41:19.172162 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81571) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 00:41:19.174675 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 00:41:19.174969 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.175125 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81571) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 00:41:19.175260 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.175417 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.175551 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.175706 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.175842 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.176025 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.176147 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.176320 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.176412 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.176591 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.176671 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.176878 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.176957 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.177159 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.177240 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.177435 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.177515 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.177715 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.177991 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.200980 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.201590 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.202459 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 00:41:19.202749 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.203087 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81571) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 00:41:19.203380 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.207324 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 00:41:19.207615 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.207918 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.208166 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81571) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 00:41:19.208457 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.208748 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.214992 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 00:41:19.215284 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.215699 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81571) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 00:41:19.216017 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.219291 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 00:41:19.219582 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.219870 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.220187 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.220469 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.221812 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81571) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 00:41:19.222121 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.222418 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.222533 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.222711 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.222826 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.222997 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.223117 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.223284 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.223566 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.223845 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.238932 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.239213 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.239674 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.239985 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.243669 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 00:41:19.244464 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81571) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 00:41:19.246859 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.247160 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.247768 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.248096 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.251546 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 00:41:19.252392 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81571) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 00:41:19.254791 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 00:41:19.255631 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81571) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 00:41:19.258047 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.258350 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.258641 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.258933 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.259014 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.259218 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.259308 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.259551 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.259640 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.259838 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.260159 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.260465 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.276144 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 00:41:19.276437 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.276713 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.276983 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.277120 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81571) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 00:41:19.277416 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.277690 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.277960 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.283792 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.284938 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.285500 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.286504 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.287055 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.287337 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.288138 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.288432 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.290406 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 00:41:19.290706 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.291250 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.291420 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81571) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 00:41:19.291540 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.291712 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.291833 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.292032 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.292329 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.292725 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.303233 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 00:41:19.304068 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.304355 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.304596 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81571) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 00:41:19.304678 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.304889 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.304970 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.305167 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.305247 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.305446 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.305536 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.305831 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.306139 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.306430 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.321186 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 00:41:19.322156 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81571) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 00:41:19.324265 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 00:41:19.325147 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81571) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 00:41:19.327179 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.328126 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.328712 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.329604 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.330190 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 00:41:19.330478 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.330763 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.331107 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81571) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 00:41:19.331399 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.331798 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.337946 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.338836 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.339366 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 00:41:19.340342 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81571) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 00:41:19.342305 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.342600 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.342888 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.343171 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.343278 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.343685 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.344006 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.344295 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.351327 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 00:41:19.351625 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.351929 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.352377 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81571) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 00:41:19.352679 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.352966 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.358895 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 00:41:19.359184 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.359470 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.359753 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.359964 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81571) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 18 00:41:19.360049 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.360259 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.360343 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.360549 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.360640 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.360838 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.360922 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.361118 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.361209 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.361399 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.361480 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.361681 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.361763 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.361951 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.362090 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.362216 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.362331 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.362482 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.362773 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.363062 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.363342 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.363617 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.363886 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81571) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 18 00:41:19.398125 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5565957999c0 pid: 81572 (default app) Sep 18 00:41:19.399607 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5565957999c0 pid: 81571 (default app) Sep 18 00:41:19.401751 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6ab73-10a3-4406-bdc2-c6dfd98d8c44 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:19.402043 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6ab73-10a3-4406-bdc2-c6dfd98d8c44 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:19.402317 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6ab73-10a3-4406-bdc2-c6dfd98d8c44 None None] PATH_INFO: `/v3` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:19.407116 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1/1] 10.222.0.15 () {50 vars in 791 bytes} [Sun Sep 18 00:41:19 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:41:26.297510 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49da0b-e8f3-4549-a6e3-312efaff5ce0 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:26.298033 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49da0b-e8f3-4549-a6e3-312efaff5ce0 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:26.298140 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49da0b-e8f3-4549-a6e3-312efaff5ce0 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:26.302336 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 1/2] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:41:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 18 00:41:26.308255 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988a8c5-4e35-4142-8f44-e8795be626ef None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:26.308792 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988a8c5-4e35-4142-8f44-e8795be626ef None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:26.308792 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988a8c5-4e35-4142-8f44-e8795be626ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:26.378811 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: INFO dbcounter [None req-f988a8c5-4e35-4142-8f44-e8795be626ef None None] Registered counter for database keystone Sep 18 00:41:26.397796 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG oslo_db.sqlalchemy.engines [None req-f988a8c5-4e35-4142-8f44-e8795be626ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81572) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 18 00:41:26.403976 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writer thread running {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 18 00:41:26.587157 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG passlib.handlers.bcrypt [None req-f988a8c5-4e35-4142-8f44-e8795be626ef None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81572) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 18 00:41:26.587459 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG passlib.handlers.bcrypt [None req-f988a8c5-4e35-4142-8f44-e8795be626ef None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81572) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 18 00:41:26.645059 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-f988a8c5-4e35-4142-8f44-e8795be626ef None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:41:26.646693 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-f988a8c5-4e35-4142-8f44-e8795be626ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:41:26.774019 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 2/3] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:41:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 467 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 18 00:41:27.086735 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49da0b-e8f3-4549-a6e3-312efaff5ce0 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:27.156012 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: INFO dbcounter [None req-3d49da0b-e8f3-4549-a6e3-312efaff5ce0 None None] Registered counter for database keystone Sep 18 00:41:27.177995 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG oslo_db.sqlalchemy.engines [None req-3d49da0b-e8f3-4549-a6e3-312efaff5ce0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81571) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 18 00:41:27.184957 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writer thread running {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 18 00:41:27.305175 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49da0b-e8f3-4549-a6e3-312efaff5ce0 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:27.309592 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df69fc98-6a72-4621-9a3a-54bec92a3e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59ffbd91d29d4939bf7137c10c138592', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:27.310225 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69fc98-6a72-4621-9a3a-54bec92a3e92 admin admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:27.310510 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69fc98-6a72-4621-9a3a-54bec92a3e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:27.310787 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69fc98-6a72-4621-9a3a-54bec92a3e92 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:27.320175 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df69fc98-6a72-4621-9a3a-54bec92a3e92 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:41:27.377296 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: WARNING keystone.common.rbac_enforcer.enforcer [None req-df69fc98-6a72-4621-9a3a-54bec92a3e92 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 18 00:41:27.377562 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df69fc98-6a72-4621-9a3a-54bec92a3e92 admin admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:41:27.388366 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 2/4] 10.222.0.15 () {58 vars in 1324 bytes} [Sun Sep 18 00:41:27 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 18 00:41:27.394301 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988a8c5-4e35-4142-8f44-e8795be626ef None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:27.411470 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988a8c5-4e35-4142-8f44-e8795be626ef None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:27.415934 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b3777e-c652-42db-9631-017e8082748c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59ffbd91d29d4939bf7137c10c138592', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:27.417317 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3777e-c652-42db-9631-017e8082748c admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:27.417597 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3777e-c652-42db-9631-017e8082748c admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:27.417868 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3777e-c652-42db-9631-017e8082748c admin admin] PATH_INFO: `/v3/projects/59ffbd91d29d4939bf7137c10c138592` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:27.419454 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b3777e-c652-42db-9631-017e8082748c admin admin] RBAC: Authorizing `identity:get_project(project_id=59ffbd91d29d4939bf7137c10c138592)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:41:27.473590 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e4b3777e-c652-42db-9631-017e8082748c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 18 00:41:27.473945 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b3777e-c652-42db-9631-017e8082748c admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:41:27.479165 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 3/5] 10.222.0.15 () {56 vars in 1207 bytes} [Sun Sep 18 00:41:27 2022] GET /identity/v3/projects/59ffbd91d29d4939bf7137c10c138592 => generated 344 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:41:29.674316 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff2372-f4b5-45ed-8ffe-d7dd93d4ee77 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:29.674823 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff2372-f4b5-45ed-8ffe-d7dd93d4ee77 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:29.674933 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff2372-f4b5-45ed-8ffe-d7dd93d4ee77 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:29.678998 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 3/6] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:41:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:41:29.684445 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51105eb-ec43-4d6f-9eb0-d5cf34a85077 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:29.684855 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51105eb-ec43-4d6f-9eb0-d5cf34a85077 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:29.685007 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51105eb-ec43-4d6f-9eb0-d5cf34a85077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:29.705026 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-e51105eb-ec43-4d6f-9eb0-d5cf34a85077 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:41:29.706557 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-e51105eb-ec43-4d6f-9eb0-d5cf34a85077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:41:29.715012 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 4/7] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:41:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 18 00:41:29.980277 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff2372-f4b5-45ed-8ffe-d7dd93d4ee77 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:29.993370 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff2372-f4b5-45ed-8ffe-d7dd93d4ee77 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:29.997594 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd0f31f-3624-4d72-8817-aa3e7df79906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59ffbd91d29d4939bf7137c10c138592', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:29.998195 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0f31f-3624-4d72-8817-aa3e7df79906 admin admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:29.998480 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0f31f-3624-4d72-8817-aa3e7df79906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:29.998758 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0f31f-3624-4d72-8817-aa3e7df79906 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:30.006618 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd0f31f-3624-4d72-8817-aa3e7df79906 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:41:30.008457 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd0f31f-3624-4d72-8817-aa3e7df79906 admin admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:41:30.017540 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 4/8] 10.222.0.15 () {58 vars in 1324 bytes} [Sun Sep 18 00:41:29 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 18 00:41:30.023189 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51105eb-ec43-4d6f-9eb0-d5cf34a85077 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:30.032251 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51105eb-ec43-4d6f-9eb0-d5cf34a85077 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:30.036566 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76616259-3e0e-4257-9cfa-a1ca518e7033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59ffbd91d29d4939bf7137c10c138592', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:30.037194 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76616259-3e0e-4257-9cfa-a1ca518e7033 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:30.037478 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76616259-3e0e-4257-9cfa-a1ca518e7033 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:30.038273 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76616259-3e0e-4257-9cfa-a1ca518e7033 admin admin] PATH_INFO: `/v3/users/0f8bf0607941426a8b8271be8b554394` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:30.039592 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76616259-3e0e-4257-9cfa-a1ca518e7033 admin admin] RBAC: Authorizing `identity:get_user(user_id=0f8bf0607941426a8b8271be8b554394)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:41:30.041727 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76616259-3e0e-4257-9cfa-a1ca518e7033 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:41:30.043247 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 5/9] 10.222.0.15 () {56 vars in 1198 bytes} [Sun Sep 18 00:41:30 2022] GET /identity/v3/users/0f8bf0607941426a8b8271be8b554394 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:41:32.289900 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c69d07-2c7f-4420-bb09-5c2cdb4408de None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:32.290475 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c69d07-2c7f-4420-bb09-5c2cdb4408de None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:32.290475 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c69d07-2c7f-4420-bb09-5c2cdb4408de None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:32.292047 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 5/10] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:41:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 18 00:41:32.297688 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65072187-4c05-4859-a270-aedaaeb10908 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:32.298113 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65072187-4c05-4859-a270-aedaaeb10908 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:32.298238 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65072187-4c05-4859-a270-aedaaeb10908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:32.313318 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ea404-5695-4f89-91fa-333e592b5797 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:32.313606 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ea404-5695-4f89-91fa-333e592b5797 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:32.313887 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ea404-5695-4f89-91fa-333e592b5797 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:32.315211 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 6/11] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:41:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:41:32.317535 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-65072187-4c05-4859-a270-aedaaeb10908 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:41:32.318726 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-65072187-4c05-4859-a270-aedaaeb10908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:41:32.320469 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f90290-a692-45a2-a66d-571f6ff6c1d2 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:32.320758 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f90290-a692-45a2-a66d-571f6ff6c1d2 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:32.321042 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f90290-a692-45a2-a66d-571f6ff6c1d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:32.362906 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG passlib.handlers.bcrypt [None req-f2f90290-a692-45a2-a66d-571f6ff6c1d2 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81571) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 18 00:41:32.363293 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG passlib.handlers.bcrypt [None req-f2f90290-a692-45a2-a66d-571f6ff6c1d2 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81571) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 18 00:41:32.400387 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 6/12] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:41:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 18 00:41:32.412206 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-f2f90290-a692-45a2-a66d-571f6ff6c1d2 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:41:32.414356 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-f2f90290-a692-45a2-a66d-571f6ff6c1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:41:32.516910 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 7/13] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:41:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 18 00:41:32.670617 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65072187-4c05-4859-a270-aedaaeb10908 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:32.695084 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:41:32.777938 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65072187-4c05-4859-a270-aedaaeb10908 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:32.787160 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f90290-a692-45a2-a66d-571f6ff6c1d2 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:32.813343 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cdb9f3-3ca1-49e6-8fab-882b5423b294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:32.814000 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cdb9f3-3ca1-49e6-8fab-882b5423b294 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:32.814287 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cdb9f3-3ca1-49e6-8fab-882b5423b294 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:32.814568 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cdb9f3-3ca1-49e6-8fab-882b5423b294 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:32.826645 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cdb9f3-3ca1-49e6-8fab-882b5423b294 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:41:32.835585 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-f1cdb9f3-3ca1-49e6-8fab-882b5423b294 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 00:41:32.835585 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:41:32.835585 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:41:32.835585 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:41:32.835585 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:41:32.835585 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:41:32.835585 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:41:32.835585 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:41:32.835585 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:41:32.835585 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:41:32.835585 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:41:32.835585 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:41:32.835585 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:41:32.835585 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:41:32.835585 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:41:32.835585 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:41:32.836750 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:41:32.836750 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:41:32.836750 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:41:32.836750 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:41:32.836750 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:41:32.836750 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:41:32.836750 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:41:32.836750 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:41:32.836750 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:41:32.836750 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:41:32.836750 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:41:32.836750 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:41:32.836750 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:41:32.836750 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:41:32.836750 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:41:32.836750 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:41:32.837556 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:41:32.837556 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:41:32.837556 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:41:32.837556 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:41:32.837556 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:41:32.837556 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:41:32.837556 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:41:32.837556 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:41:32.837556 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:41:32.837556 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:41:32.837556 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 00:41:32.837556 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:41:32.837556 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 7/14] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Sep 18 00:41:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:41:32.842754 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cdb9f3-3ca1-49e6-8fab-882b5423b294 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:32.891147 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f90290-a692-45a2-a66d-571f6ff6c1d2 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:32.893469 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:41:32.926930 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:41:32.930292 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f08913-34d9-4e81-bb07-26238ca2ad19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:32.931175 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f08913-34d9-4e81-bb07-26238ca2ad19 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:32.931457 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f08913-34d9-4e81-bb07-26238ca2ad19 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:32.931734 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f08913-34d9-4e81-bb07-26238ca2ad19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:32.947357 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cdb9f3-3ca1-49e6-8fab-882b5423b294 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:32.982135 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373222b5-08dd-43b8-86c2-ac55d6706e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:32.982747 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373222b5-08dd-43b8-86c2-ac55d6706e0d None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:32.983027 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373222b5-08dd-43b8-86c2-ac55d6706e0d None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:32.983300 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373222b5-08dd-43b8-86c2-ac55d6706e0d None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:32.983992 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373222b5-08dd-43b8-86c2-ac55d6706e0d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:41:32.984298 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373222b5-08dd-43b8-86c2-ac55d6706e0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:41:32.985695 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373222b5-08dd-43b8-86c2-ac55d6706e0d None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:41:32.998346 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 8/15] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Sep 18 00:41:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:41:33.001590 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f08913-34d9-4e81-bb07-26238ca2ad19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:41:33.003171 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f08913-34d9-4e81-bb07-26238ca2ad19 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:41:33.004571 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373222b5-08dd-43b8-86c2-ac55d6706e0d None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:33.110616 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 8/16] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Sep 18 00:41:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 00:41:33.113206 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373222b5-08dd-43b8-86c2-ac55d6706e0d None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:33.116381 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f08913-34d9-4e81-bb07-26238ca2ad19 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:33.119393 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:41:33.158445 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d76f33-9422-4cce-8670-a48d6568f40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:33.159092 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d76f33-9422-4cce-8670-a48d6568f40d None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:33.159377 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d76f33-9422-4cce-8670-a48d6568f40d None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:33.159656 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d76f33-9422-4cce-8670-a48d6568f40d None admin] PATH_INFO: `/v3/users/0f8bf0607941426a8b8271be8b554394` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:33.160869 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d76f33-9422-4cce-8670-a48d6568f40d None admin] RBAC: Authorizing `identity:get_user(user_id=0f8bf0607941426a8b8271be8b554394)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:41:33.162363 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d76f33-9422-4cce-8670-a48d6568f40d None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:41:33.164598 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 9/17] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Sep 18 00:41:33 2022] GET /identity/v3/users/0f8bf0607941426a8b8271be8b554394 => generated 247 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:41:33.170397 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d76f33-9422-4cce-8670-a48d6568f40d None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:33.186391 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:41:33.231145 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f08913-34d9-4e81-bb07-26238ca2ad19 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:33.266757 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9862e339-f7c8-4e46-b7a0-e072b8a3ce45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:33.267621 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9862e339-f7c8-4e46-b7a0-e072b8a3ce45 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:33.267923 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9862e339-f7c8-4e46-b7a0-e072b8a3ce45 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:33.268202 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9862e339-f7c8-4e46-b7a0-e072b8a3ce45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:33.283562 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d76f33-9422-4cce-8670-a48d6568f40d None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:33.287313 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9862e339-f7c8-4e46-b7a0-e072b8a3ce45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:41:33.289372 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9862e339-f7c8-4e46-b7a0-e072b8a3ce45 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:41:33.307840 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-9862e339-f7c8-4e46-b7a0-e072b8a3ce45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:41:33.307840 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:41:33.307840 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:41:33.307840 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:41:33.307840 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:41:33.307840 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:41:33.307840 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:41:33.307840 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:41:33.307840 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:41:33.307840 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:41:33.307840 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:41:33.307840 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:41:33.307840 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:41:33.307840 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:41:33.307840 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:41:33.307840 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:41:33.309183 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:41:33.309183 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:41:33.309183 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:41:33.309183 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:41:33.309183 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:41:33.309183 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:41:33.309183 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:41:33.309183 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:41:33.309183 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:41:33.309183 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:41:33.309183 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:41:33.309183 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:41:33.309183 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:41:33.309183 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:41:33.309183 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:41:33.309183 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:41:33.309183 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:41:33.309944 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:41:33.309944 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:41:33.309944 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:41:33.309944 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 9/18] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:41:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 00:41:33.314870 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9862e339-f7c8-4e46-b7a0-e072b8a3ce45 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:33.324675 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca40a56-2004-453c-9afb-b5c496c2bb65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:33.325947 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca40a56-2004-453c-9afb-b5c496c2bb65 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:33.326234 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca40a56-2004-453c-9afb-b5c496c2bb65 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:33.326523 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca40a56-2004-453c-9afb-b5c496c2bb65 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:33.327694 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca40a56-2004-453c-9afb-b5c496c2bb65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:41:33.329218 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca40a56-2004-453c-9afb-b5c496c2bb65 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:41:33.330790 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 10/19] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:41:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:41:33.337179 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca40a56-2004-453c-9afb-b5c496c2bb65 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:33.375717 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:41:33.421279 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:41:33.425058 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9862e339-f7c8-4e46-b7a0-e072b8a3ce45 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:33.442217 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca40a56-2004-453c-9afb-b5c496c2bb65 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:33.460537 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb12fc69-413b-4359-9fb1-9c2657832a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:33.461157 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb12fc69-413b-4359-9fb1-9c2657832a99 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:33.461444 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb12fc69-413b-4359-9fb1-9c2657832a99 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:33.461718 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb12fc69-413b-4359-9fb1-9c2657832a99 None admin] PATH_INFO: `/v3/domains` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:33.462366 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb12fc69-413b-4359-9fb1-9c2657832a99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:41:33.462667 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb12fc69-413b-4359-9fb1-9c2657832a99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:41:33.464100 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb12fc69-413b-4359-9fb1-9c2657832a99 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:41:33.477291 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c3926d-b638-49a2-8a7a-a99cb266db0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:33.477910 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c3926d-b638-49a2-8a7a-a99cb266db0e None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:33.478193 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c3926d-b638-49a2-8a7a-a99cb266db0e None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:33.478467 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c3926d-b638-49a2-8a7a-a99cb266db0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:33.479200 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c3926d-b638-49a2-8a7a-a99cb266db0e None admin] RBAC: Adding query filter params (role.id=591d4711dc204cf98003c8b7d7558506, scope.domain.id=default, user.id=0f8bf0607941426a8b8271be8b554394) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:41:33.479507 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c3926d-b638-49a2-8a7a-a99cb266db0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:41:33.480988 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c3926d-b638-49a2-8a7a-a99cb266db0e None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:41:33.481732 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 10/20] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:41:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:41:33.488246 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 11/21] 10.222.0.15 () {56 vars in 1322 bytes} [Sun Sep 18 00:41:33 2022] GET /identity/v3/role_assignments?user.id=0f8bf0607941426a8b8271be8b554394&scope.domain.id=default&role.id=591d4711dc204cf98003c8b7d7558506 => generated 233 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:41:36.097410 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85fe96b-e334-4735-97bf-16fabadc72fd None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:36.097921 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85fe96b-e334-4735-97bf-16fabadc72fd None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:36.098026 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85fe96b-e334-4735-97bf-16fabadc72fd None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:36.099497 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 11/22] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:41:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:41:36.108482 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7464f-e969-44e7-b0f7-d817b26de986 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:36.109004 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7464f-e969-44e7-b0f7-d817b26de986 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:36.109083 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7464f-e969-44e7-b0f7-d817b26de986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:36.136102 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-47f7464f-e969-44e7-b0f7-d817b26de986 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:41:36.137373 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-47f7464f-e969-44e7-b0f7-d817b26de986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:41:36.240328 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 12/23] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:41:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 18 00:41:36.910744 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4713ba-ddfc-4899-86a5-be4d0c021771 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:36.911236 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4713ba-ddfc-4899-86a5-be4d0c021771 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:36.911606 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4713ba-ddfc-4899-86a5-be4d0c021771 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:36.914168 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 12/24] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:41:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 18 00:41:36.922977 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a06767-b5e7-4b1f-b524-edde503a9073 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:36.923425 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a06767-b5e7-4b1f-b524-edde503a9073 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:36.923969 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a06767-b5e7-4b1f-b524-edde503a9073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:36.965856 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-c5a06767-b5e7-4b1f-b524-edde503a9073 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:41:36.967939 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-c5a06767-b5e7-4b1f-b524-edde503a9073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:41:37.029646 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8762ad11-a479-46b8-940a-5b196f5c22b9 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:37.030151 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8762ad11-a479-46b8-940a-5b196f5c22b9 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:37.030643 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8762ad11-a479-46b8-940a-5b196f5c22b9 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:37.033290 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 13/25] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:41:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:41:37.034527 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8762ad11-a479-46b8-940a-5b196f5c22b9 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:37.155346 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 13/26] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:41:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 00:41:37.157903 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bcc2c6-f697-437d-9ea1-cdcb82fe524e None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:37.158413 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bcc2c6-f697-437d-9ea1-cdcb82fe524e None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:37.161608 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bcc2c6-f697-437d-9ea1-cdcb82fe524e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:37.188714 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:41:37.215939 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-f1bcc2c6-f697-437d-9ea1-cdcb82fe524e None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:41:37.218576 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-f1bcc2c6-f697-437d-9ea1-cdcb82fe524e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:41:37.351203 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8762ad11-a479-46b8-940a-5b196f5c22b9 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:37.379855 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:41:37.403747 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 14/27] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:41:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 00:41:37.406116 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916521b0-bafd-4b58-9923-7c657c582163 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:37.406826 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916521b0-bafd-4b58-9923-7c657c582163 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:37.407584 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916521b0-bafd-4b58-9923-7c657c582163 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:37.410508 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 15/28] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:41:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:41:37.423360 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2094f-687e-461b-969e-958673e521c8 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:37.424328 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2094f-687e-461b-969e-958673e521c8 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:37.425133 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2094f-687e-461b-969e-958673e521c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:37.436329 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9551fb-5340-4f90-b59c-a6f0a2ddb404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:37.439925 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9551fb-5340-4f90-b59c-a6f0a2ddb404 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:37.439925 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9551fb-5340-4f90-b59c-a6f0a2ddb404 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:37.439925 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9551fb-5340-4f90-b59c-a6f0a2ddb404 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:37.479416 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-44d2094f-687e-461b-969e-958673e521c8 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:41:37.484316 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-44d2094f-687e-461b-969e-958673e521c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:41:37.491662 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9551fb-5340-4f90-b59c-a6f0a2ddb404 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:41:37.494438 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9551fb-5340-4f90-b59c-a6f0a2ddb404 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:41:37.535386 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-5a9551fb-5340-4f90-b59c-a6f0a2ddb404 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:41:37.535386 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:41:37.535386 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:41:37.535386 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:41:37.535386 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:41:37.535386 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:41:37.535386 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:41:37.535386 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:41:37.535386 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:41:37.535386 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:41:37.535386 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:41:37.535386 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:41:37.535386 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:41:37.535386 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:41:37.535386 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:41:37.535386 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:41:37.537097 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:41:37.537097 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:41:37.537097 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:41:37.537097 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:41:37.537097 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:41:37.537097 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:41:37.537097 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:41:37.537097 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:41:37.537097 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:41:37.537097 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:41:37.537097 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:41:37.537097 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:41:37.537097 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:41:37.537097 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:41:37.537097 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:41:37.537097 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:41:37.537097 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:41:37.539253 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:41:37.539253 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:41:37.539253 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:41:37.545742 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 14/29] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:41:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 512 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:41:37.552303 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9551fb-5340-4f90-b59c-a6f0a2ddb404 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:37.640885 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 16/30] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:41:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 00:41:37.643241 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d2094f-687e-461b-969e-958673e521c8 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:37.773223 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:41:37.806968 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9551fb-5340-4f90-b59c-a6f0a2ddb404 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:37.862016 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d2094f-687e-461b-969e-958673e521c8 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:37.864392 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f2dfde-6169-4f39-afc9-93674ca39b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:37.865022 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f2dfde-6169-4f39-afc9-93674ca39b35 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:37.865300 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f2dfde-6169-4f39-afc9-93674ca39b35 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:37.865609 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f2dfde-6169-4f39-afc9-93674ca39b35 None admin] PATH_INFO: `/v3/domains` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:37.866267 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f2dfde-6169-4f39-afc9-93674ca39b35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:41:37.866572 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f2dfde-6169-4f39-afc9-93674ca39b35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:41:37.874259 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f2dfde-6169-4f39-afc9-93674ca39b35 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:41:37.904861 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 15/31] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:41:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:41:37.915935 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f2dfde-6169-4f39-afc9-93674ca39b35 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:37.968930 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b5231-7798-421d-8aba-3f026f4200cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:37.969581 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b5231-7798-421d-8aba-3f026f4200cf None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:37.969872 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b5231-7798-421d-8aba-3f026f4200cf None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:37.970130 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b5231-7798-421d-8aba-3f026f4200cf None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:37.970831 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933b5231-7798-421d-8aba-3f026f4200cf None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:41:37.972547 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933b5231-7798-421d-8aba-3f026f4200cf None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:41:37.974304 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:41:38.138288 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f2dfde-6169-4f39-afc9-93674ca39b35 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:38.151649 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 17/32] 10.222.0.15 () {60 vars in 1131 bytes} [Sun Sep 18 00:41:37 2022] POST /identity/v3/roles => generated 219 bytes in 509 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 00:41:38.152704 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b5231-7798-421d-8aba-3f026f4200cf None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:38.211437 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905446f8-4cbf-44e0-aeee-5988b6c2b9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:38.212572 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905446f8-4cbf-44e0-aeee-5988b6c2b9a3 None admin] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:38.213066 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905446f8-4cbf-44e0-aeee-5988b6c2b9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:38.213777 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905446f8-4cbf-44e0-aeee-5988b6c2b9a3 None admin] PATH_INFO: `/v3/projects` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:38.214974 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905446f8-4cbf-44e0-aeee-5988b6c2b9a3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:41:38.224134 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905446f8-4cbf-44e0-aeee-5988b6c2b9a3 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:41:38.362643 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b5231-7798-421d-8aba-3f026f4200cf None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:38.420553 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:41:38.443411 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea4f4e-40d3-4c13-8795-361a0e850d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:38.443411 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea4f4e-40d3-4c13-8795-361a0e850d7b None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:38.443411 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea4f4e-40d3-4c13-8795-361a0e850d7b None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:38.443411 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea4f4e-40d3-4c13-8795-361a0e850d7b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:38.461375 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ea4f4e-40d3-4c13-8795-361a0e850d7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:41:38.465455 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 16/33] 10.222.0.15 () {60 vars in 1141 bytes} [Sun Sep 18 00:41:37 2022] POST /identity/v3/projects => generated 301 bytes in 550 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 00:41:38.467269 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905446f8-4cbf-44e0-aeee-5988b6c2b9a3 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:38.475985 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-10ea4f4e-40d3-4c13-8795-361a0e850d7b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 00:41:38.475985 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:41:38.475985 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:41:38.475985 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:41:38.475985 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:41:38.475985 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:41:38.475985 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:41:38.475985 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:41:38.475985 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:41:38.475985 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:41:38.475985 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:41:38.475985 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:41:38.475985 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:41:38.475985 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:41:38.475985 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:41:38.475985 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:41:38.478621 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:41:38.478621 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:41:38.478621 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:41:38.478621 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:41:38.478621 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:41:38.478621 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:41:38.478621 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:41:38.478621 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:41:38.478621 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:41:38.478621 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:41:38.478621 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:41:38.478621 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:41:38.478621 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:41:38.478621 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:41:38.478621 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:41:38.478621 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:41:38.481037 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:41:38.481037 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:41:38.481037 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:41:38.481037 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:41:38.481037 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:41:38.481037 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:41:38.481037 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:41:38.481037 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:41:38.481037 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:41:38.481037 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:41:38.481037 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 00:41:38.481037 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:41:38.486616 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 18/34] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Sep 18 00:41:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:41:38.489538 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a971465-44f4-4c87-9dfc-ee5dbc1c77a1 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:38.490422 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a971465-44f4-4c87-9dfc-ee5dbc1c77a1 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:38.491367 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a971465-44f4-4c87-9dfc-ee5dbc1c77a1 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:38.494331 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 19/35] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:41:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:41:38.501355 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5231bdf-6257-44e8-8735-1b87a85ba666 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:38.501745 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5231bdf-6257-44e8-8735-1b87a85ba666 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:38.501901 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5231bdf-6257-44e8-8735-1b87a85ba666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:38.532065 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-e5231bdf-6257-44e8-8735-1b87a85ba666 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:41:38.535211 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-e5231bdf-6257-44e8-8735-1b87a85ba666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:41:38.609051 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:41:38.636430 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905446f8-4cbf-44e0-aeee-5988b6c2b9a3 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:38.649350 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 20/36] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:41:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 00:41:38.652120 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5231bdf-6257-44e8-8735-1b87a85ba666 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:38.705227 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6465af3-d7ff-4e27-b1c9-51449eae8966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:38.706483 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6465af3-d7ff-4e27-b1c9-51449eae8966 None admin] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:38.706967 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6465af3-d7ff-4e27-b1c9-51449eae8966 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:38.707441 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6465af3-d7ff-4e27-b1c9-51449eae8966 None admin] PATH_INFO: `/v3/roles` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:38.709855 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6465af3-d7ff-4e27-b1c9-51449eae8966 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:41:38.712955 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6465af3-d7ff-4e27-b1c9-51449eae8966 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:41:38.742845 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 17/37] 10.222.0.15 () {60 vars in 1131 bytes} [Sun Sep 18 00:41:38 2022] POST /identity/v3/roles => generated 225 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 00:41:38.744858 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb605de9-f127-4360-9668-6e629bb22c64 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:38.745149 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb605de9-f127-4360-9668-6e629bb22c64 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:38.745437 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb605de9-f127-4360-9668-6e629bb22c64 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:38.746780 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 18/38] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:41:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:41:38.752867 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275c56e-5b2f-4ae4-9ce5-e05c466bdfc3 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:38.753249 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275c56e-5b2f-4ae4-9ce5-e05c466bdfc3 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:38.753435 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275c56e-5b2f-4ae4-9ce5-e05c466bdfc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:38.779593 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-c275c56e-5b2f-4ae4-9ce5-e05c466bdfc3 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:41:38.781271 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-c275c56e-5b2f-4ae4-9ce5-e05c466bdfc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:41:38.864967 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5231bdf-6257-44e8-8735-1b87a85ba666 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:38.878788 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 19/39] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:41:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 18 00:41:38.908242 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:41:38.933653 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898d0f95-1221-4a63-b05e-aa98b89ef383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:38.934656 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d0f95-1221-4a63-b05e-aa98b89ef383 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:38.935142 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d0f95-1221-4a63-b05e-aa98b89ef383 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:38.935626 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d0f95-1221-4a63-b05e-aa98b89ef383 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:38.936917 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898d0f95-1221-4a63-b05e-aa98b89ef383 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:41:38.937456 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898d0f95-1221-4a63-b05e-aa98b89ef383 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:41:38.940145 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898d0f95-1221-4a63-b05e-aa98b89ef383 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:41:38.951582 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c275c56e-5b2f-4ae4-9ce5-e05c466bdfc3 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:38.956751 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 21/40] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Sep 18 00:41:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:41:38.965069 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898d0f95-1221-4a63-b05e-aa98b89ef383 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:39.072784 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:41:39.134697 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c275c56e-5b2f-4ae4-9ce5-e05c466bdfc3 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:39.195342 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf054ea2-9336-4bc7-bc0d-0863a8af9ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:39.196239 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf054ea2-9336-4bc7-bc0d-0863a8af9ff9 None admin] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:39.196652 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf054ea2-9336-4bc7-bc0d-0863a8af9ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:39.197072 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf054ea2-9336-4bc7-bc0d-0863a8af9ff9 None admin] PATH_INFO: `/v3/roles` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:39.197910 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf054ea2-9336-4bc7-bc0d-0863a8af9ff9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:41:39.199547 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf054ea2-9336-4bc7-bc0d-0863a8af9ff9 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:41:39.216976 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 20/41] 10.222.0.15 () {60 vars in 1131 bytes} [Sun Sep 18 00:41:38 2022] POST /identity/v3/roles => generated 223 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 00:41:39.217755 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf054ea2-9336-4bc7-bc0d-0863a8af9ff9 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:39.352522 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898d0f95-1221-4a63-b05e-aa98b89ef383 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:39.359282 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf054ea2-9336-4bc7-bc0d-0863a8af9ff9 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:39.404725 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:41:39.418590 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b1300-5a44-4ecb-bc27-468dd36ff75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:39.420974 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b1300-5a44-4ecb-bc27-468dd36ff75c None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:39.421478 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b1300-5a44-4ecb-bc27-468dd36ff75c None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:39.421995 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b1300-5a44-4ecb-bc27-468dd36ff75c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:39.422531 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e9137e-2d67-43a8-8db9-d7eb49570926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:39.423604 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e9137e-2d67-43a8-8db9-d7eb49570926 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:39.424130 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e9137e-2d67-43a8-8db9-d7eb49570926 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:39.424570 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e9137e-2d67-43a8-8db9-d7eb49570926 None admin] PATH_INFO: `/v3/users/0f8bf0607941426a8b8271be8b554394` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:39.425664 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80b1300-5a44-4ecb-bc27-468dd36ff75c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:41:39.426187 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e9137e-2d67-43a8-8db9-d7eb49570926 None admin] RBAC: Authorizing `identity:get_user(user_id=0f8bf0607941426a8b8271be8b554394)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:41:39.428489 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e9137e-2d67-43a8-8db9-d7eb49570926 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:41:39.428923 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80b1300-5a44-4ecb-bc27-468dd36ff75c None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:41:39.431203 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 22/42] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Sep 18 00:41:38 2022] GET /identity/v3/users/0f8bf0607941426a8b8271be8b554394 => generated 247 bytes in 468 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:41:39.432058 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 21/43] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:41:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:41:39.437799 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e9137e-2d67-43a8-8db9-d7eb49570926 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:39.440047 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b1300-5a44-4ecb-bc27-468dd36ff75c None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:39.513827 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:41:39.581718 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e9137e-2d67-43a8-8db9-d7eb49570926 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:39.619567 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eecd63-ff87-486e-9761-6986f89f5cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:39.620242 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eecd63-ff87-486e-9761-6986f89f5cd1 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:39.620532 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eecd63-ff87-486e-9761-6986f89f5cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:39.620623 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b1300-5a44-4ecb-bc27-468dd36ff75c None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:39.621057 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eecd63-ff87-486e-9761-6986f89f5cd1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:39.621981 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eecd63-ff87-486e-9761-6986f89f5cd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:41:39.623550 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eecd63-ff87-486e-9761-6986f89f5cd1 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:41:39.625300 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 23/44] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:41:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:41:39.634601 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eecd63-ff87-486e-9761-6986f89f5cd1 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:39.665217 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fa3502-8c6b-4c73-8233-a1ada15bec41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:39.666513 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa3502-8c6b-4c73-8233-a1ada15bec41 None admin] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:39.667009 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa3502-8c6b-4c73-8233-a1ada15bec41 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:39.667509 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa3502-8c6b-4c73-8233-a1ada15bec41 None admin] PATH_INFO: `/v3/projects` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:39.668758 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fa3502-8c6b-4c73-8233-a1ada15bec41 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:41:39.671223 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fa3502-8c6b-4c73-8233-a1ada15bec41 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:41:39.710872 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 22/45] 10.222.0.15 () {60 vars in 1141 bytes} [Sun Sep 18 00:41:39 2022] POST /identity/v3/projects => generated 312 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 00:41:39.771286 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eecd63-ff87-486e-9761-6986f89f5cd1 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:39.789819 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:41:39.820351 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88218c4b-0c8a-403b-b0a9-cdbe03457833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:39.821427 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88218c4b-0c8a-403b-b0a9-cdbe03457833 None admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:39.821935 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88218c4b-0c8a-403b-b0a9-cdbe03457833 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:39.822375 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88218c4b-0c8a-403b-b0a9-cdbe03457833 None admin] PATH_INFO: `/v3/domains/default/users/0f8bf0607941426a8b8271be8b554394/roles/591d4711dc204cf98003c8b7d7558506` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:39.826295 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88218c4b-0c8a-403b-b0a9-cdbe03457833 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=0f8bf0607941426a8b8271be8b554394, role_id=591d4711dc204cf98003c8b7d7558506)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:41:39.829049 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88218c4b-0c8a-403b-b0a9-cdbe03457833 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:41:39.852626 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 24/46] 10.222.0.15 () {58 vars in 1361 bytes} [Sun Sep 18 00:41:39 2022] PUT /identity/v3/domains/default/users/0f8bf0607941426a8b8271be8b554394/roles/591d4711dc204cf98003c8b7d7558506 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 00:41:42.001387 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19369269-b666-424d-b8f1-937ae4c2aad8 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:42.001905 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19369269-b666-424d-b8f1-937ae4c2aad8 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:42.001987 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19369269-b666-424d-b8f1-937ae4c2aad8 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:42.003498 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 23/47] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:41:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:41:42.008875 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c670c2-e863-4bea-a71a-6451b1d2ec5e None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:42.009329 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c670c2-e863-4bea-a71a-6451b1d2ec5e None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:42.009602 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c670c2-e863-4bea-a71a-6451b1d2ec5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:42.027755 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-f5c670c2-e863-4bea-a71a-6451b1d2ec5e None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:41:42.028993 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-f5c670c2-e863-4bea-a71a-6451b1d2ec5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:41:42.105055 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 25/48] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:41:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 00:41:42.195683 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67ba21-5dcf-4c4e-880f-0dd4109ac001 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:42.196093 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67ba21-5dcf-4c4e-880f-0dd4109ac001 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:42.196444 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67ba21-5dcf-4c4e-880f-0dd4109ac001 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:42.197899 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 24/49] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:41:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:41:42.203218 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe69a3-775e-43e0-b6e1-fa9e6c48c692 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:42.203510 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe69a3-775e-43e0-b6e1-fa9e6c48c692 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:42.203792 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe69a3-775e-43e0-b6e1-fa9e6c48c692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:42.221567 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-63fe69a3-775e-43e0-b6e1-fa9e6c48c692 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:41:42.222737 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-63fe69a3-775e-43e0-b6e1-fa9e6c48c692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:41:42.286933 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 26/50] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:41:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 00:41:42.375190 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b67ba21-5dcf-4c4e-880f-0dd4109ac001 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:42.435052 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:41:42.487228 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b67ba21-5dcf-4c4e-880f-0dd4109ac001 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:42.528229 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4f39c1-e64d-41da-9cea-87f9e0d2585b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:42.528884 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f39c1-e64d-41da-9cea-87f9e0d2585b None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:42.529174 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f39c1-e64d-41da-9cea-87f9e0d2585b None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:42.529454 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f39c1-e64d-41da-9cea-87f9e0d2585b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:42.530594 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4f39c1-e64d-41da-9cea-87f9e0d2585b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:41:42.532073 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4f39c1-e64d-41da-9cea-87f9e0d2585b None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:41:42.533661 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 25/51] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:41:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:41:42.539900 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe69a3-775e-43e0-b6e1-fa9e6c48c692 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:42.551541 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4f39c1-e64d-41da-9cea-87f9e0d2585b None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:42.570772 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:41:42.641869 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe69a3-775e-43e0-b6e1-fa9e6c48c692 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:42.652204 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4f39c1-e64d-41da-9cea-87f9e0d2585b None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:42.670242 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:41:42.677386 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4837f7b0-855c-483c-9741-a5b4d5b2f0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:42.678012 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837f7b0-855c-483c-9741-a5b4d5b2f0d1 None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:42.678297 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837f7b0-855c-483c-9741-a5b4d5b2f0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:42.678576 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837f7b0-855c-483c-9741-a5b4d5b2f0d1 None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:42.679234 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4837f7b0-855c-483c-9741-a5b4d5b2f0d1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:41:42.680737 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4837f7b0-855c-483c-9741-a5b4d5b2f0d1 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:41:42.687128 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d9b9b-f858-42a0-8121-e43d30dde9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:42.687774 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d9b9b-f858-42a0-8121-e43d30dde9c1 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:42.688090 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d9b9b-f858-42a0-8121-e43d30dde9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:42.688370 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d9b9b-f858-42a0-8121-e43d30dde9c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:42.701393 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166d9b9b-f858-42a0-8121-e43d30dde9c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:41:42.708347 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-166d9b9b-f858-42a0-8121-e43d30dde9c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 00:41:42.708347 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:41:42.708347 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:41:42.708347 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:41:42.708347 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:41:42.708347 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:41:42.708347 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:41:42.708347 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:41:42.708347 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:41:42.708347 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:41:42.708347 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:41:42.708347 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:41:42.708347 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:41:42.708347 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:41:42.708347 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:41:42.708347 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:41:42.709820 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:41:42.709820 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:41:42.709820 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:41:42.709820 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:41:42.709820 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:41:42.709820 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:41:42.709820 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:41:42.709820 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:41:42.709820 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:41:42.709820 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:41:42.709820 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:41:42.709820 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:41:42.709820 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:41:42.709820 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:41:42.709820 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:41:42.709820 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:41:42.710882 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:41:42.710882 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:41:42.710882 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:41:42.710882 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:41:42.710882 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:41:42.710882 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:41:42.710882 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:41:42.710882 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:41:42.710882 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:41:42.710882 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:41:42.710882 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 00:41:42.710882 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:41:42.710882 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 26/52] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Sep 18 00:41:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 00:41:42.711767 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 27/53] 10.222.0.15 () {60 vars in 1140 bytes} [Sun Sep 18 00:41:42 2022] POST /identity/v3/projects => generated 298 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 00:41:42.715842 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d9b9b-f858-42a0-8121-e43d30dde9c1 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:42.830404 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d9b9b-f858-42a0-8121-e43d30dde9c1 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:42.867468 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643bc8ca-7ebb-4c12-8b2d-723b47ec1563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:42.868143 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643bc8ca-7ebb-4c12-8b2d-723b47ec1563 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:42.868434 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643bc8ca-7ebb-4c12-8b2d-723b47ec1563 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:42.868711 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643bc8ca-7ebb-4c12-8b2d-723b47ec1563 None admin] PATH_INFO: `/v3/roles` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:42.869400 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643bc8ca-7ebb-4c12-8b2d-723b47ec1563 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:41:42.869710 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643bc8ca-7ebb-4c12-8b2d-723b47ec1563 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:41:42.871142 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643bc8ca-7ebb-4c12-8b2d-723b47ec1563 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:41:42.884760 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 27/54] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Sep 18 00:41:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:41:42.890742 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4837f7b0-855c-483c-9741-a5b4d5b2f0d1 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:42.988303 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:41:43.005829 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4837f7b0-855c-483c-9741-a5b4d5b2f0d1 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:43.041816 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f173a32-2e7c-426f-9878-b277a7740734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:43.042472 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f173a32-2e7c-426f-9878-b277a7740734 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:43.042760 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f173a32-2e7c-426f-9878-b277a7740734 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:43.043040 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f173a32-2e7c-426f-9878-b277a7740734 None admin] PATH_INFO: `/v3/users/0f8bf0607941426a8b8271be8b554394` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:43.044244 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f173a32-2e7c-426f-9878-b277a7740734 None admin] RBAC: Authorizing `identity:get_user(user_id=0f8bf0607941426a8b8271be8b554394)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:41:43.047124 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f173a32-2e7c-426f-9878-b277a7740734 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:41:43.048885 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 28/55] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Sep 18 00:41:42 2022] GET /identity/v3/users/0f8bf0607941426a8b8271be8b554394 => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:41:43.055240 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643bc8ca-7ebb-4c12-8b2d-723b47ec1563 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:43.108314 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:41:43.168611 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643bc8ca-7ebb-4c12-8b2d-723b47ec1563 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:43.203808 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029389bf-5ec6-4c47-9a2f-65eb53d9a344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:43.204560 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029389bf-5ec6-4c47-9a2f-65eb53d9a344 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:43.204852 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029389bf-5ec6-4c47-9a2f-65eb53d9a344 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:43.205130 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029389bf-5ec6-4c47-9a2f-65eb53d9a344 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:43.206246 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029389bf-5ec6-4c47-9a2f-65eb53d9a344 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:41:43.207698 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029389bf-5ec6-4c47-9a2f-65eb53d9a344 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:41:43.210035 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 28/56] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:41:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:41:43.215613 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f173a32-2e7c-426f-9878-b277a7740734 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:43.322602 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f173a32-2e7c-426f-9878-b277a7740734 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:43.356164 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe84460-359a-4910-84ce-6517f756a6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:43.356779 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe84460-359a-4910-84ce-6517f756a6fa None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:43.357069 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe84460-359a-4910-84ce-6517f756a6fa None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:43.357359 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe84460-359a-4910-84ce-6517f756a6fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:43.358087 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe84460-359a-4910-84ce-6517f756a6fa None admin] RBAC: Adding query filter params (role.id=591d4711dc204cf98003c8b7d7558506, scope.domain.id=default, user.id=0f8bf0607941426a8b8271be8b554394) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:41:43.358452 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe84460-359a-4910-84ce-6517f756a6fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:41:43.359849 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe84460-359a-4910-84ce-6517f756a6fa None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:41:43.366143 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 29/57] 10.222.0.15 () {56 vars in 1322 bytes} [Sun Sep 18 00:41:43 2022] GET /identity/v3/role_assignments?user.id=0f8bf0607941426a8b8271be8b554394&scope.domain.id=default&role.id=591d4711dc204cf98003c8b7d7558506 => generated 530 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:41:45.004130 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea2c9f-346a-493e-a19b-85d1962228d7 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:45.004645 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea2c9f-346a-493e-a19b-85d1962228d7 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:45.004729 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea2c9f-346a-493e-a19b-85d1962228d7 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:45.006009 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 29/58] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:41:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:41:45.011182 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c2ba4-3562-4a43-bd83-7dbc4bc91fda None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:45.011589 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c2ba4-3562-4a43-bd83-7dbc4bc91fda None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:45.011761 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c2ba4-3562-4a43-bd83-7dbc4bc91fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:45.030838 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-787c2ba4-3562-4a43-bd83-7dbc4bc91fda None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:41:45.032156 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-787c2ba4-3562-4a43-bd83-7dbc4bc91fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:41:45.046595 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:41:45.107918 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 30/59] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:41:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 00:41:45.379321 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea2c9f-346a-493e-a19b-85d1962228d7 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:45.590286 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea2c9f-346a-493e-a19b-85d1962228d7 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:45.601287 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:41:45.626930 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a1db14-c750-400a-bb53-30ddecdfb3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:45.627559 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1db14-c750-400a-bb53-30ddecdfb3ba None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:45.627845 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1db14-c750-400a-bb53-30ddecdfb3ba None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:45.628154 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1db14-c750-400a-bb53-30ddecdfb3ba None admin] PATH_INFO: `/v3/domains/default` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:45.629289 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a1db14-c750-400a-bb53-30ddecdfb3ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:41:45.630792 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a1db14-c750-400a-bb53-30ddecdfb3ba None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:41:45.632351 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 30/60] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:41:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:41:45.637963 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c2ba4-3562-4a43-bd83-7dbc4bc91fda None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:45.738641 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c2ba4-3562-4a43-bd83-7dbc4bc91fda None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:45.774057 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e15ace-02cb-4a0b-b2c2-8e6a802cd498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:45.774680 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e15ace-02cb-4a0b-b2c2-8e6a802cd498 None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:45.774969 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e15ace-02cb-4a0b-b2c2-8e6a802cd498 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:45.775254 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e15ace-02cb-4a0b-b2c2-8e6a802cd498 None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:45.775942 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e15ace-02cb-4a0b-b2c2-8e6a802cd498 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:41:45.777419 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e15ace-02cb-4a0b-b2c2-8e6a802cd498 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:41:45.805454 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 31/61] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Sep 18 00:41:45 2022] POST /identity/v3/users => generated 275 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 00:41:49.331068 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986524d2-e4b0-422b-a442-d77b1c7bac08 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:49.332701 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986524d2-e4b0-422b-a442-d77b1c7bac08 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:49.333526 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986524d2-e4b0-422b-a442-d77b1c7bac08 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:49.336879 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 31/62] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:41:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:41:49.342796 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c81561-d5e0-489b-adc4-92c94fae7d4b None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:49.343494 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c81561-d5e0-489b-adc4-92c94fae7d4b None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:49.343494 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c81561-d5e0-489b-adc4-92c94fae7d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:49.350067 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:41:49.366245 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-21c81561-d5e0-489b-adc4-92c94fae7d4b None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:41:49.367448 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-21c81561-d5e0-489b-adc4-92c94fae7d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:41:49.477763 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 32/63] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:41:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 00:41:49.502747 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e95cd-bd8c-4f03-a69c-2c9014475e37 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:49.503587 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e95cd-bd8c-4f03-a69c-2c9014475e37 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:49.504288 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e95cd-bd8c-4f03-a69c-2c9014475e37 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:49.508052 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 32/64] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:41:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:41:49.513614 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad15c4c-c397-4dc0-a936-d5e017562165 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:49.513961 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad15c4c-c397-4dc0-a936-d5e017562165 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:49.514251 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad15c4c-c397-4dc0-a936-d5e017562165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:49.541260 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-4ad15c4c-c397-4dc0-a936-d5e017562165 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:41:49.542750 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-4ad15c4c-c397-4dc0-a936-d5e017562165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:41:49.653561 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 33/65] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:41:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 18 00:41:49.685699 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe94029-2889-4246-9f0c-a0818a0d4339 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:49.686634 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe94029-2889-4246-9f0c-a0818a0d4339 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:49.687410 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe94029-2889-4246-9f0c-a0818a0d4339 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:49.690228 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 33/66] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:41:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:41:49.696592 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e54835-fd0a-47cd-8baa-50a1bfae632a None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:49.697234 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e54835-fd0a-47cd-8baa-50a1bfae632a None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:49.697747 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e54835-fd0a-47cd-8baa-50a1bfae632a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:49.725398 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-d2e54835-fd0a-47cd-8baa-50a1bfae632a None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:41:49.727173 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-d2e54835-fd0a-47cd-8baa-50a1bfae632a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:41:49.820550 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:41:49.845866 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ca287-ee18-4011-a87e-37b5a6ae3825 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:49.846356 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ca287-ee18-4011-a87e-37b5a6ae3825 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:49.846860 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ca287-ee18-4011-a87e-37b5a6ae3825 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:49.849487 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 34/67] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:41:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:41:49.850086 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 34/68] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:41:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 00:41:49.855627 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643898d-1445-4ca1-8a68-9262861bf283 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:49.855955 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643898d-1445-4ca1-8a68-9262861bf283 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:49.856247 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643898d-1445-4ca1-8a68-9262861bf283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:49.884571 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-c643898d-1445-4ca1-8a68-9262861bf283 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:41:49.885820 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-c643898d-1445-4ca1-8a68-9262861bf283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:41:49.901470 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e54835-fd0a-47cd-8baa-50a1bfae632a None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:49.969468 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 35/69] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:41:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 18 00:41:50.077592 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e54835-fd0a-47cd-8baa-50a1bfae632a None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:50.108223 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c643898d-1445-4ca1-8a68-9262861bf283 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:50.119057 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f742d841-da33-4368-9b02-96b92670f464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:50.119715 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742d841-da33-4368-9b02-96b92670f464 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:50.120028 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742d841-da33-4368-9b02-96b92670f464 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:50.120308 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742d841-da33-4368-9b02-96b92670f464 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:50.144974 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f742d841-da33-4368-9b02-96b92670f464 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:41:50.150595 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-f742d841-da33-4368-9b02-96b92670f464 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 18 00:41:50.150595 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:41:50.150595 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:41:50.150595 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:41:50.150595 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:41:50.150595 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:41:50.150595 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:41:50.150595 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:41:50.150595 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:41:50.150595 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:41:50.150595 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:41:50.150595 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:41:50.150595 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:41:50.150595 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:41:50.150595 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:41:50.150595 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:41:50.151505 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:41:50.151505 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:41:50.151505 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:41:50.151505 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:41:50.151505 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:41:50.151505 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:41:50.151505 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:41:50.151505 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:41:50.151505 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:41:50.151505 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:41:50.151505 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:41:50.151505 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:41:50.151505 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:41:50.151505 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:41:50.151505 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:41:50.151505 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:41:50.152662 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:41:50.152662 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:41:50.152662 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:41:50.152662 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:41:50.152662 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:41:50.152662 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:41:50.152662 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:41:50.152662 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:41:50.152662 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:41:50.152662 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:41:50.152662 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 18 00:41:50.152662 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:41:50.152662 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 35/70] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Sep 18 00:41:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:41:50.161019 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f742d841-da33-4368-9b02-96b92670f464 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:50.236258 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:41:50.249572 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c643898d-1445-4ca1-8a68-9262861bf283 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:50.259450 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:41:50.295185 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7de8e8-1258-4483-9c20-0a8b28ec0733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:50.295847 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7de8e8-1258-4483-9c20-0a8b28ec0733 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:50.296632 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7de8e8-1258-4483-9c20-0a8b28ec0733 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:50.296927 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7de8e8-1258-4483-9c20-0a8b28ec0733 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:50.303631 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f742d841-da33-4368-9b02-96b92670f464 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:50.310163 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7de8e8-1258-4483-9c20-0a8b28ec0733 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:41:50.317315 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-8b7de8e8-1258-4483-9c20-0a8b28ec0733 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 00:41:50.317315 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:41:50.317315 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:41:50.317315 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:41:50.317315 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:41:50.317315 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:41:50.317315 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:41:50.317315 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:41:50.317315 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:41:50.317315 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:41:50.317315 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:41:50.317315 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:41:50.317315 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:41:50.317315 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:41:50.317315 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:41:50.317315 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:41:50.318932 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:41:50.318932 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:41:50.318932 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:41:50.318932 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:41:50.318932 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:41:50.318932 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:41:50.318932 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:41:50.318932 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:41:50.318932 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:41:50.318932 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:41:50.318932 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:41:50.318932 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:41:50.318932 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:41:50.318932 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:41:50.318932 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:41:50.318932 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:41:50.319685 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:41:50.319685 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:41:50.319685 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:41:50.319685 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:41:50.319685 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:41:50.319685 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:41:50.319685 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:41:50.319685 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:41:50.319685 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:41:50.319685 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:41:50.319685 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 00:41:50.319685 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:41:50.320585 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 36/71] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Sep 18 00:41:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:41:50.322102 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd1d7f-6207-49fd-b1b9-9a8371e3e250 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:50.322395 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd1d7f-6207-49fd-b1b9-9a8371e3e250 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:50.322671 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd1d7f-6207-49fd-b1b9-9a8371e3e250 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:50.324117 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 37/72] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:41:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:41:50.328816 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd1d7f-6207-49fd-b1b9-9a8371e3e250 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:50.350779 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e150638-3283-45ec-ba20-9fb549d29cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:50.351408 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e150638-3283-45ec-ba20-9fb549d29cfa None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:50.351692 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e150638-3283-45ec-ba20-9fb549d29cfa None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:50.352007 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e150638-3283-45ec-ba20-9fb549d29cfa None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:50.352681 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e150638-3283-45ec-ba20-9fb549d29cfa None admin] RBAC: Adding query filter params (name=member) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:41:50.352987 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e150638-3283-45ec-ba20-9fb549d29cfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:41:50.354386 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e150638-3283-45ec-ba20-9fb549d29cfa None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:41:50.362945 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 36/73] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Sep 18 00:41:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:41:50.363795 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e150638-3283-45ec-ba20-9fb549d29cfa None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:50.447938 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd1d7f-6207-49fd-b1b9-9a8371e3e250 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:50.479487 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e150638-3283-45ec-ba20-9fb549d29cfa None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:50.486963 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3498a701-9f07-401d-bcd1-6e8fca35dec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:50.487540 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498a701-9f07-401d-bcd1-6e8fca35dec4 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:50.487825 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498a701-9f07-401d-bcd1-6e8fca35dec4 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:50.488116 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498a701-9f07-401d-bcd1-6e8fca35dec4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:50.498423 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:41:50.504012 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3498a701-9f07-401d-bcd1-6e8fca35dec4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:41:50.509766 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-3498a701-9f07-401d-bcd1-6e8fca35dec4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 18 00:41:50.509766 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:41:50.509766 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:41:50.509766 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:41:50.509766 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:41:50.509766 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:41:50.509766 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:41:50.509766 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:41:50.509766 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:41:50.509766 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:41:50.509766 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:41:50.509766 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:41:50.509766 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:41:50.509766 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:41:50.509766 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:41:50.509766 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:41:50.513161 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:41:50.513161 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:41:50.513161 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:41:50.513161 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:41:50.513161 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:41:50.513161 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:41:50.513161 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:41:50.513161 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:41:50.513161 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:41:50.513161 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:41:50.513161 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:41:50.513161 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:41:50.513161 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:41:50.513161 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:41:50.513161 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:41:50.513161 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:41:50.513981 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:41:50.513981 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:41:50.513981 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:41:50.513981 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:41:50.513981 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:41:50.513981 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:41:50.513981 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:41:50.513981 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:41:50.513981 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:41:50.513981 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:41:50.513981 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 18 00:41:50.513981 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:41:50.513981 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 38/74] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Sep 18 00:41:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:41:50.513981 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a0dbb-1805-4f89-bb9f-833179969ec3 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:50.514727 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a0dbb-1805-4f89-bb9f-833179969ec3 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:50.514727 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a0dbb-1805-4f89-bb9f-833179969ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:50.526007 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d510ea2a-bd41-4224-9ce0-ebfbbc06fb8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:50.526635 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510ea2a-bd41-4224-9ce0-ebfbbc06fb8c None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:50.526927 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510ea2a-bd41-4224-9ce0-ebfbbc06fb8c None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:50.527211 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510ea2a-bd41-4224-9ce0-ebfbbc06fb8c None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:50.527908 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d510ea2a-bd41-4224-9ce0-ebfbbc06fb8c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:41:50.528227 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d510ea2a-bd41-4224-9ce0-ebfbbc06fb8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:41:50.529646 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d510ea2a-bd41-4224-9ce0-ebfbbc06fb8c None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:41:50.531527 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-af1a0dbb-1805-4f89-bb9f-833179969ec3 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:41:50.532757 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-af1a0dbb-1805-4f89-bb9f-833179969ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:41:50.538436 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 37/75] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Sep 18 00:41:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:41:50.539272 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d510ea2a-bd41-4224-9ce0-ebfbbc06fb8c None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:50.555680 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:41:50.619937 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 39/76] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:41:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 00:41:50.619937 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1a0dbb-1805-4f89-bb9f-833179969ec3 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:50.666878 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d510ea2a-bd41-4224-9ce0-ebfbbc06fb8c None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:50.720190 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f08ae6-861f-492d-9a8d-56beb4eeacda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:50.721167 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f08ae6-861f-492d-9a8d-56beb4eeacda None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:50.721646 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f08ae6-861f-492d-9a8d-56beb4eeacda None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:50.722113 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f08ae6-861f-492d-9a8d-56beb4eeacda None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:50.739700 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f08ae6-861f-492d-9a8d-56beb4eeacda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:41:50.750781 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-22f08ae6-861f-492d-9a8d-56beb4eeacda None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 18 00:41:50.750781 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:41:50.750781 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:41:50.750781 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:41:50.750781 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:41:50.750781 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:41:50.750781 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:41:50.750781 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:41:50.750781 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:41:50.750781 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:41:50.750781 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:41:50.750781 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:41:50.750781 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:41:50.750781 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:41:50.750781 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:41:50.750781 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:41:50.751633 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:41:50.751633 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:41:50.751633 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:41:50.751633 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:41:50.751633 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:41:50.751633 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:41:50.751633 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:41:50.751633 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:41:50.751633 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:41:50.751633 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:41:50.751633 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:41:50.751633 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:41:50.751633 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:41:50.751633 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:41:50.751633 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:41:50.751633 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:41:50.752495 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:41:50.752495 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:41:50.752495 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:41:50.752495 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:41:50.752495 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:41:50.752495 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:41:50.752495 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:41:50.752495 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:41:50.752495 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:41:50.752495 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:41:50.752495 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 18 00:41:50.752495 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:41:50.752495 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 38/77] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Sep 18 00:41:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:41:50.753604 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f08ae6-861f-492d-9a8d-56beb4eeacda None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:50.763567 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1a0dbb-1805-4f89-bb9f-833179969ec3 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:50.803680 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:41:50.813762 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf645f5-65f9-4bfe-bc7c-46510776dac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:50.814799 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf645f5-65f9-4bfe-bc7c-46510776dac3 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:50.815314 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf645f5-65f9-4bfe-bc7c-46510776dac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:50.815738 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf645f5-65f9-4bfe-bc7c-46510776dac3 None admin] PATH_INFO: `/v3/users/1c01447d95d54e7ba8fab62b6917c9ae` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:50.841859 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf645f5-65f9-4bfe-bc7c-46510776dac3 None admin] RBAC: Authorizing `identity:get_user(user_id=1c01447d95d54e7ba8fab62b6917c9ae)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:41:50.843354 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf645f5-65f9-4bfe-bc7c-46510776dac3 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:41:50.845088 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 40/78] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Sep 18 00:41:50 2022] GET /identity/v3/users/1c01447d95d54e7ba8fab62b6917c9ae => generated 275 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:41:50.845875 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf645f5-65f9-4bfe-bc7c-46510776dac3 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:50.872655 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:41:50.903584 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f08ae6-861f-492d-9a8d-56beb4eeacda None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:50.943141 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd1bb9a-a5e1-409c-a71a-5013bc4de5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:50.943808 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1bb9a-a5e1-409c-a71a-5013bc4de5aa None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:50.944149 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1bb9a-a5e1-409c-a71a-5013bc4de5aa None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:50.944447 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1bb9a-a5e1-409c-a71a-5013bc4de5aa None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:50.945138 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd1bb9a-a5e1-409c-a71a-5013bc4de5aa None admin] RBAC: Adding query filter params (name=member) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:41:50.945454 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd1bb9a-a5e1-409c-a71a-5013bc4de5aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:41:50.946890 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd1bb9a-a5e1-409c-a71a-5013bc4de5aa None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:41:50.955639 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 39/79] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Sep 18 00:41:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:41:50.956437 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd1bb9a-a5e1-409c-a71a-5013bc4de5aa None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:50.978908 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf645f5-65f9-4bfe-bc7c-46510776dac3 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:51.014509 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5195414-35d8-40b3-af32-f40bc5c870c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:51.015071 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5195414-35d8-40b3-af32-f40bc5c870c4 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:51.015352 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5195414-35d8-40b3-af32-f40bc5c870c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:51.015629 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5195414-35d8-40b3-af32-f40bc5c870c4 None admin] PATH_INFO: `/v3/users/0f8bf0607941426a8b8271be8b554394` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:51.016817 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5195414-35d8-40b3-af32-f40bc5c870c4 None admin] RBAC: Authorizing `identity:get_user(user_id=0f8bf0607941426a8b8271be8b554394)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:41:51.018269 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5195414-35d8-40b3-af32-f40bc5c870c4 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:41:51.020094 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 41/80] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Sep 18 00:41:50 2022] GET /identity/v3/users/0f8bf0607941426a8b8271be8b554394 => generated 247 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:41:51.020727 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5195414-35d8-40b3-af32-f40bc5c870c4 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:51.064416 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:41:51.069727 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd1bb9a-a5e1-409c-a71a-5013bc4de5aa None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:51.111032 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3295580-d04e-4a50-ae6f-41e33b74f2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:51.111770 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3295580-d04e-4a50-ae6f-41e33b74f2cc None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:51.112106 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3295580-d04e-4a50-ae6f-41e33b74f2cc None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:51.112390 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3295580-d04e-4a50-ae6f-41e33b74f2cc None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:51.113069 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3295580-d04e-4a50-ae6f-41e33b74f2cc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:41:51.113384 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3295580-d04e-4a50-ae6f-41e33b74f2cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:41:51.114793 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3295580-d04e-4a50-ae6f-41e33b74f2cc None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:41:51.119457 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:41:51.124170 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 40/81] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Sep 18 00:41:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:41:51.125183 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3295580-d04e-4a50-ae6f-41e33b74f2cc None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:51.139776 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5195414-35d8-40b3-af32-f40bc5c870c4 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:51.179439 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8391b37-f623-4f12-88d7-5172a79411f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:51.180204 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8391b37-f623-4f12-88d7-5172a79411f5 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:51.180557 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8391b37-f623-4f12-88d7-5172a79411f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:51.180901 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8391b37-f623-4f12-88d7-5172a79411f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:51.234490 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3295580-d04e-4a50-ae6f-41e33b74f2cc None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:51.259489 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8391b37-f623-4f12-88d7-5172a79411f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:41:51.261128 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8391b37-f623-4f12-88d7-5172a79411f5 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:41:51.272299 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdff1245-0a18-40c3-b76b-1bce7c6a8fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:51.272841 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff1245-0a18-40c3-b76b-1bce7c6a8fc0 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:51.273127 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff1245-0a18-40c3-b76b-1bce7c6a8fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:51.273414 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff1245-0a18-40c3-b76b-1bce7c6a8fc0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:51.274614 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdff1245-0a18-40c3-b76b-1bce7c6a8fc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:41:51.276147 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdff1245-0a18-40c3-b76b-1bce7c6a8fc0 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:41:51.277786 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 41/82] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:41:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:41:51.280259 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdff1245-0a18-40c3-b76b-1bce7c6a8fc0 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:51.311695 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:41:51.359035 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:41:51.391090 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 42/83] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Sep 18 00:41:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 00:41:51.392131 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8391b37-f623-4f12-88d7-5172a79411f5 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:51.404073 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdff1245-0a18-40c3-b76b-1bce7c6a8fc0 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:51.441964 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d5cbe-c30b-4600-bcc7-95158668c00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:51.442619 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d5cbe-c30b-4600-bcc7-95158668c00a None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:51.442899 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d5cbe-c30b-4600-bcc7-95158668c00a None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:51.443177 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d5cbe-c30b-4600-bcc7-95158668c00a None admin] PATH_INFO: `/v3/users/1c01447d95d54e7ba8fab62b6917c9ae` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:51.444769 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6d5cbe-c30b-4600-bcc7-95158668c00a None admin] RBAC: Authorizing `identity:get_user(user_id=1c01447d95d54e7ba8fab62b6917c9ae)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:41:51.446254 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6d5cbe-c30b-4600-bcc7-95158668c00a None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:41:51.447875 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 42/84] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Sep 18 00:41:51 2022] GET /identity/v3/users/1c01447d95d54e7ba8fab62b6917c9ae => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:41:51.448693 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d5cbe-c30b-4600-bcc7-95158668c00a None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:51.512796 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8391b37-f623-4f12-88d7-5172a79411f5 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:51.551087 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d006562d-8c2b-4de3-b3ea-269b6e297457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:51.551633 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006562d-8c2b-4de3-b3ea-269b6e297457 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:51.551950 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006562d-8c2b-4de3-b3ea-269b6e297457 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:51.552237 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006562d-8c2b-4de3-b3ea-269b6e297457 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:51.568726 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:41:51.579445 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d5cbe-c30b-4600-bcc7-95158668c00a None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:51.618959 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d4c40-56c2-45b8-ba31-895ece52054f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:51.619238 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:41:51.619607 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d4c40-56c2-45b8-ba31-895ece52054f None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:51.620301 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d4c40-56c2-45b8-ba31-895ece52054f None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:51.620579 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d4c40-56c2-45b8-ba31-895ece52054f None admin] PATH_INFO: `/v3/users/1c01447d95d54e7ba8fab62b6917c9ae` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:51.621855 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190d4c40-56c2-45b8-ba31-895ece52054f None admin] RBAC: Authorizing `identity:get_user(user_id=1c01447d95d54e7ba8fab62b6917c9ae)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:41:51.623343 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190d4c40-56c2-45b8-ba31-895ece52054f None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:41:51.625017 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 43/85] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Sep 18 00:41:51 2022] GET /identity/v3/users/1c01447d95d54e7ba8fab62b6917c9ae => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:41:51.625802 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d4c40-56c2-45b8-ba31-895ece52054f None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:51.652862 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d006562d-8c2b-4de3-b3ea-269b6e297457 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:41:51.654398 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d006562d-8c2b-4de3-b3ea-269b6e297457 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:41:51.754501 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d4c40-56c2-45b8-ba31-895ece52054f None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:51.784985 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 43/86] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Sep 18 00:41:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 00:41:51.785868 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d006562d-8c2b-4de3-b3ea-269b6e297457 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:51.801278 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5db79-aa22-4228-b363-9e7b19db10d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:51.801841 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5db79-aa22-4228-b363-9e7b19db10d4 None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:51.802166 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5db79-aa22-4228-b363-9e7b19db10d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:51.802504 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5db79-aa22-4228-b363-9e7b19db10d4 None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:51.803264 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff5db79-aa22-4228-b363-9e7b19db10d4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:41:51.804990 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff5db79-aa22-4228-b363-9e7b19db10d4 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:41:51.829825 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 44/87] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Sep 18 00:41:51 2022] POST /identity/v3/users => generated 289 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 00:41:51.830942 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5db79-aa22-4228-b363-9e7b19db10d4 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:51.882946 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:41:51.905844 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:41:51.934092 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d006562d-8c2b-4de3-b3ea-269b6e297457 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:51.987554 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1cbdd9-dcd4-48ec-8b67-e74f2938aa7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:51.988413 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1cbdd9-dcd4-48ec-8b67-e74f2938aa7e None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:51.988817 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1cbdd9-dcd4-48ec-8b67-e74f2938aa7e None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:51.989235 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1cbdd9-dcd4-48ec-8b67-e74f2938aa7e None admin] PATH_INFO: `/v3/projects/71680fa1985e4fc4a5c1a73f87753f66` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:51.990922 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1cbdd9-dcd4-48ec-8b67-e74f2938aa7e None admin] RBAC: Authorizing `identity:get_project(project_id=71680fa1985e4fc4a5c1a73f87753f66)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:41:51.993233 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1cbdd9-dcd4-48ec-8b67-e74f2938aa7e None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:41:52.003337 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 44/88] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Sep 18 00:41:51 2022] GET /identity/v3/projects/71680fa1985e4fc4a5c1a73f87753f66 => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:41:52.003337 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1cbdd9-dcd4-48ec-8b67-e74f2938aa7e None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:52.033568 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5db79-aa22-4228-b363-9e7b19db10d4 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:52.087649 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65001720-bbf9-40e4-8459-53d0cee74b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:52.089216 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65001720-bbf9-40e4-8459-53d0cee74b77 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:52.089216 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65001720-bbf9-40e4-8459-53d0cee74b77 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:52.089216 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65001720-bbf9-40e4-8459-53d0cee74b77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:52.178442 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1cbdd9-dcd4-48ec-8b67-e74f2938aa7e None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:52.212895 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65001720-bbf9-40e4-8459-53d0cee74b77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:41:52.215663 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65001720-bbf9-40e4-8459-53d0cee74b77 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:41:52.264277 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:41:52.264520 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba79fbc-7336-42c0-9656-bbe2400f694f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:52.266021 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba79fbc-7336-42c0-9656-bbe2400f694f None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:52.266743 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba79fbc-7336-42c0-9656-bbe2400f694f None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:52.267257 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba79fbc-7336-42c0-9656-bbe2400f694f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:52.300788 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:41:52.379732 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba79fbc-7336-42c0-9656-bbe2400f694f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:41:52.382059 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba79fbc-7336-42c0-9656-bbe2400f694f None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:41:52.389027 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 45/89] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Sep 18 00:41:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 00:41:52.389740 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65001720-bbf9-40e4-8459-53d0cee74b77 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:52.525394 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 45/90] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Sep 18 00:41:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 00:41:52.526128 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba79fbc-7336-42c0-9656-bbe2400f694f None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:52.537757 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65001720-bbf9-40e4-8459-53d0cee74b77 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:52.565516 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:41:52.586001 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948bab98-d9dc-48b4-a87d-923991b4419f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:52.586668 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948bab98-d9dc-48b4-a87d-923991b4419f None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:52.586957 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948bab98-d9dc-48b4-a87d-923991b4419f None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:52.587240 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948bab98-d9dc-48b4-a87d-923991b4419f None admin] PATH_INFO: `/v3/projects/71680fa1985e4fc4a5c1a73f87753f66` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:52.588966 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948bab98-d9dc-48b4-a87d-923991b4419f None admin] RBAC: Authorizing `identity:get_project(project_id=71680fa1985e4fc4a5c1a73f87753f66)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:41:52.591194 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948bab98-d9dc-48b4-a87d-923991b4419f None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:41:52.594602 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 46/91] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Sep 18 00:41:52 2022] GET /identity/v3/projects/71680fa1985e4fc4a5c1a73f87753f66 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:41:52.595698 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948bab98-d9dc-48b4-a87d-923991b4419f None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:52.605129 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:41:52.670921 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba79fbc-7336-42c0-9656-bbe2400f694f None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:52.709852 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e7978-4d69-4976-8058-6ab0c4a4ed7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:52.710548 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e7978-4d69-4976-8058-6ab0c4a4ed7f None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:52.710839 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e7978-4d69-4976-8058-6ab0c4a4ed7f None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:52.711117 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e7978-4d69-4976-8058-6ab0c4a4ed7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:52.712073 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e7978-4d69-4976-8058-6ab0c4a4ed7f None admin] RBAC: Adding query filter params (role.id=59d7218a321b4c20bc1996494a48a2a1, scope.project.id=71680fa1985e4fc4a5c1a73f87753f66, user.id=1c01447d95d54e7ba8fab62b6917c9ae) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:41:52.712396 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e7978-4d69-4976-8058-6ab0c4a4ed7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:41:52.714124 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e7978-4d69-4976-8058-6ab0c4a4ed7f None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:41:52.728077 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 46/92] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Sep 18 00:41:52 2022] GET /identity/v3/role_assignments?user.id=1c01447d95d54e7ba8fab62b6917c9ae&scope.project.id=71680fa1985e4fc4a5c1a73f87753f66&role.id=59d7218a321b4c20bc1996494a48a2a1 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:41:52.729037 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e7978-4d69-4976-8058-6ab0c4a4ed7f None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:52.780816 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948bab98-d9dc-48b4-a87d-923991b4419f None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:52.871667 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dec180-5622-4041-85f9-cd75dc572433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:52.872390 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dec180-5622-4041-85f9-cd75dc572433 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:52.872716 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dec180-5622-4041-85f9-cd75dc572433 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:52.873001 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dec180-5622-4041-85f9-cd75dc572433 None admin] PATH_INFO: `/v3/projects/dfe5fc7a6d694e58898af7d697d5eb2b` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:52.874499 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dec180-5622-4041-85f9-cd75dc572433 None admin] RBAC: Authorizing `identity:get_project(project_id=dfe5fc7a6d694e58898af7d697d5eb2b)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:41:52.877327 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dec180-5622-4041-85f9-cd75dc572433 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:41:52.880545 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 47/93] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Sep 18 00:41:52 2022] GET /identity/v3/projects/dfe5fc7a6d694e58898af7d697d5eb2b => generated 312 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:41:52.882146 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dec180-5622-4041-85f9-cd75dc572433 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:53.003802 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e7978-4d69-4976-8058-6ab0c4a4ed7f None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:53.040474 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:41:53.049622 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:41:53.076663 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dec180-5622-4041-85f9-cd75dc572433 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:53.102341 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe06c1dd-e0d5-4723-b7ce-da91570ad903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:53.103009 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06c1dd-e0d5-4723-b7ce-da91570ad903 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:53.103288 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06c1dd-e0d5-4723-b7ce-da91570ad903 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:53.103577 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06c1dd-e0d5-4723-b7ce-da91570ad903 None admin] PATH_INFO: `/v3/projects/71680fa1985e4fc4a5c1a73f87753f66` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:53.113471 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe06c1dd-e0d5-4723-b7ce-da91570ad903 None admin] RBAC: Authorizing `identity:get_project(project_id=71680fa1985e4fc4a5c1a73f87753f66)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:41:53.115734 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5344ad-a6de-4a20-9a7b-fd1af4dfb51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:53.115974 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe06c1dd-e0d5-4723-b7ce-da91570ad903 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:41:53.116390 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5344ad-a6de-4a20-9a7b-fd1af4dfb51f None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:53.116731 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5344ad-a6de-4a20-9a7b-fd1af4dfb51f None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:53.117008 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5344ad-a6de-4a20-9a7b-fd1af4dfb51f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:53.117809 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5344ad-a6de-4a20-9a7b-fd1af4dfb51f None admin] RBAC: Adding query filter params (role.id=591d4711dc204cf98003c8b7d7558506, scope.project.id=71680fa1985e4fc4a5c1a73f87753f66, user.id=0f8bf0607941426a8b8271be8b554394) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:41:53.118049 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 47/94] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Sep 18 00:41:52 2022] GET /identity/v3/projects/71680fa1985e4fc4a5c1a73f87753f66 => generated 298 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:41:53.118170 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5344ad-a6de-4a20-9a7b-fd1af4dfb51f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:41:53.118722 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe06c1dd-e0d5-4723-b7ce-da91570ad903 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:53.119764 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5344ad-a6de-4a20-9a7b-fd1af4dfb51f None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:41:53.126592 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 48/95] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Sep 18 00:41:52 2022] GET /identity/v3/role_assignments?user.id=0f8bf0607941426a8b8271be8b554394&scope.project.id=71680fa1985e4fc4a5c1a73f87753f66&role.id=591d4711dc204cf98003c8b7d7558506 => generated 259 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:41:53.127217 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5344ad-a6de-4a20-9a7b-fd1af4dfb51f None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:53.340266 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe06c1dd-e0d5-4723-b7ce-da91570ad903 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:53.402372 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5344ad-a6de-4a20-9a7b-fd1af4dfb51f None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:53.418341 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8a5cbc-2fdd-48f1-8fff-db95b8255171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:53.419113 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a5cbc-2fdd-48f1-8fff-db95b8255171 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:53.419404 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a5cbc-2fdd-48f1-8fff-db95b8255171 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:53.419685 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a5cbc-2fdd-48f1-8fff-db95b8255171 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:53.420467 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8a5cbc-2fdd-48f1-8fff-db95b8255171 None admin] RBAC: Adding query filter params (role.id=59d7218a321b4c20bc1996494a48a2a1, scope.project.id=dfe5fc7a6d694e58898af7d697d5eb2b, user.id=1c01447d95d54e7ba8fab62b6917c9ae) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:41:53.420785 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8a5cbc-2fdd-48f1-8fff-db95b8255171 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:41:53.422262 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8a5cbc-2fdd-48f1-8fff-db95b8255171 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:41:53.440402 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:41:53.442737 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 48/96] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Sep 18 00:41:53 2022] GET /identity/v3/role_assignments?user.id=1c01447d95d54e7ba8fab62b6917c9ae&scope.project.id=dfe5fc7a6d694e58898af7d697d5eb2b&role.id=59d7218a321b4c20bc1996494a48a2a1 => generated 259 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:41:53.485050 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff82ca1-842f-4862-a825-23f652e3b0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:53.486188 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff82ca1-842f-4862-a825-23f652e3b0ee None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:53.486685 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff82ca1-842f-4862-a825-23f652e3b0ee None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:53.487171 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff82ca1-842f-4862-a825-23f652e3b0ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:53.488593 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff82ca1-842f-4862-a825-23f652e3b0ee None admin] RBAC: Adding query filter params (role.id=e2a7bd363c424c5380514254ad1cc522, scope.project.id=71680fa1985e4fc4a5c1a73f87753f66, user.id=1c01447d95d54e7ba8fab62b6917c9ae) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:41:53.489150 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff82ca1-842f-4862-a825-23f652e3b0ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:41:53.491543 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff82ca1-842f-4862-a825-23f652e3b0ee None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:41:53.507382 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 49/97] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Sep 18 00:41:53 2022] GET /identity/v3/role_assignments?user.id=1c01447d95d54e7ba8fab62b6917c9ae&scope.project.id=71680fa1985e4fc4a5c1a73f87753f66&role.id=e2a7bd363c424c5380514254ad1cc522 => generated 259 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:41:55.064519 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869d1c5-3f40-4eb9-a373-7d5452da651b None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:55.065668 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869d1c5-3f40-4eb9-a373-7d5452da651b None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:55.066167 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869d1c5-3f40-4eb9-a373-7d5452da651b None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:55.067944 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 49/98] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:41:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:41:55.074881 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8632c-5377-4a7b-9e4a-fd4fe6447fdb None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:55.076016 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8632c-5377-4a7b-9e4a-fd4fe6447fdb None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:55.076511 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8632c-5377-4a7b-9e4a-fd4fe6447fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:55.097949 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-f0c8632c-5377-4a7b-9e4a-fd4fe6447fdb None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:41:55.099598 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-f0c8632c-5377-4a7b-9e4a-fd4fe6447fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:41:55.187419 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 50/99] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:41:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 00:41:55.588643 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3899781-9e92-4049-bfcd-f1a915e00b48 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:55.589327 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3899781-9e92-4049-bfcd-f1a915e00b48 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:55.589809 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3899781-9e92-4049-bfcd-f1a915e00b48 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:55.591499 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 50/100] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:41:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:41:55.612465 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518e990-41dc-4a40-bf74-844c1da56698 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:55.612985 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518e990-41dc-4a40-bf74-844c1da56698 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:55.613450 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518e990-41dc-4a40-bf74-844c1da56698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:55.643352 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-b518e990-41dc-4a40-bf74-844c1da56698 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:41:55.645556 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-b518e990-41dc-4a40-bf74-844c1da56698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:41:55.757867 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3899781-9e92-4049-bfcd-f1a915e00b48 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:55.795776 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 51/101] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:41:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 00:41:55.843030 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:41:55.887400 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb6274-756f-43ff-b1c7-1d6bc09d55be None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:55.887878 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb6274-756f-43ff-b1c7-1d6bc09d55be None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:55.888514 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb6274-756f-43ff-b1c7-1d6bc09d55be None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:55.890990 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 52/102] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:41:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:41:55.901837 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e60841-7c65-4438-b802-d22121071986 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:55.902703 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e60841-7c65-4438-b802-d22121071986 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:55.903670 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e60841-7c65-4438-b802-d22121071986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:55.943232 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-15e60841-7c65-4438-b802-d22121071986 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:41:55.944930 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3899781-9e92-4049-bfcd-f1a915e00b48 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:55.947290 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-15e60841-7c65-4438-b802-d22121071986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:41:56.033901 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab4e2cc-9a32-42d8-867e-27799a9df97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:56.036066 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab4e2cc-9a32-42d8-867e-27799a9df97f None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:56.038113 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab4e2cc-9a32-42d8-867e-27799a9df97f None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:56.039163 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab4e2cc-9a32-42d8-867e-27799a9df97f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:56.042608 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab4e2cc-9a32-42d8-867e-27799a9df97f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:41:56.044230 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab4e2cc-9a32-42d8-867e-27799a9df97f None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:41:56.046047 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 51/103] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:41:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:41:56.051948 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab4e2cc-9a32-42d8-867e-27799a9df97f None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:56.060662 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:41:56.190241 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 53/104] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:41:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 18 00:41:56.221790 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e60841-7c65-4438-b802-d22121071986 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:56.235092 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab4e2cc-9a32-42d8-867e-27799a9df97f None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:56.268419 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:41:56.295152 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd2170-114c-4aef-a325-5b0a9d72fae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:56.296134 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd2170-114c-4aef-a325-5b0a9d72fae6 None admin] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:56.296581 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd2170-114c-4aef-a325-5b0a9d72fae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:56.296996 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd2170-114c-4aef-a325-5b0a9d72fae6 None admin] PATH_INFO: `/v3/projects` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:56.297806 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fd2170-114c-4aef-a325-5b0a9d72fae6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:41:56.299456 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fd2170-114c-4aef-a325-5b0a9d72fae6 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:41:56.359838 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 52/105] 10.222.0.15 () {60 vars in 1141 bytes} [Sun Sep 18 00:41:56 2022] POST /identity/v3/projects => generated 302 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 00:41:56.522246 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e60841-7c65-4438-b802-d22121071986 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:56.582702 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a92fef-d5a5-4d69-bd61-ffed496d8357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:56.583292 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a92fef-d5a5-4d69-bd61-ffed496d8357 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:56.583581 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a92fef-d5a5-4d69-bd61-ffed496d8357 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:56.583941 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a92fef-d5a5-4d69-bd61-ffed496d8357 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:56.608980 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a92fef-d5a5-4d69-bd61-ffed496d8357 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:41:56.614058 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-34a92fef-d5a5-4d69-bd61-ffed496d8357 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 18 00:41:56.614058 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:41:56.614058 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:41:56.614058 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:41:56.614058 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:41:56.614058 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:41:56.614058 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:41:56.614058 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:41:56.614058 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:41:56.614058 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:41:56.614058 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:41:56.614058 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:41:56.614058 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:41:56.614058 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:41:56.614058 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:41:56.614058 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:41:56.614938 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:41:56.614938 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:41:56.614938 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:41:56.614938 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:41:56.614938 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:41:56.614938 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:41:56.614938 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:41:56.614938 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:41:56.614938 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:41:56.614938 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:41:56.614938 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:41:56.614938 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:41:56.614938 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:41:56.614938 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:41:56.614938 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:41:56.614938 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:41:56.616291 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:41:56.616291 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:41:56.616291 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:41:56.616291 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:41:56.616291 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:41:56.616291 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:41:56.616291 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:41:56.616291 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:41:56.616291 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:41:56.616291 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:41:56.616291 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 18 00:41:56.616291 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:41:56.616291 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 54/106] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Sep 18 00:41:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 396 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:41:56.622599 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd2170-114c-4aef-a325-5b0a9d72fae6 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:56.777830 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd2170-114c-4aef-a325-5b0a9d72fae6 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:56.815507 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2262f765-a800-4a3b-8a97-9e834678e17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:56.816521 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262f765-a800-4a3b-8a97-9e834678e17b None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:56.817001 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262f765-a800-4a3b-8a97-9e834678e17b None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:56.817467 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262f765-a800-4a3b-8a97-9e834678e17b None admin] PATH_INFO: `/v3/roles` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:56.818405 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2262f765-a800-4a3b-8a97-9e834678e17b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:41:56.818905 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2262f765-a800-4a3b-8a97-9e834678e17b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:41:56.820554 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2262f765-a800-4a3b-8a97-9e834678e17b None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:41:56.829921 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 53/107] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Sep 18 00:41:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:41:56.836311 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a92fef-d5a5-4d69-bd61-ffed496d8357 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:56.864370 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2262f765-a800-4a3b-8a97-9e834678e17b None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:56.900440 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:41:56.915038 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:41:56.986932 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2262f765-a800-4a3b-8a97-9e834678e17b None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:57.025813 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d128eb6-9400-4f24-ab6a-6d3fc441f38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:57.026702 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d128eb6-9400-4f24-ab6a-6d3fc441f38b None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:57.027145 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d128eb6-9400-4f24-ab6a-6d3fc441f38b None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:57.027603 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d128eb6-9400-4f24-ab6a-6d3fc441f38b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:57.042309 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d128eb6-9400-4f24-ab6a-6d3fc441f38b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:41:57.047811 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-8d128eb6-9400-4f24-ab6a-6d3fc441f38b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 18 00:41:57.047811 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:41:57.047811 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:41:57.047811 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:41:57.047811 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:41:57.047811 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:41:57.047811 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:41:57.047811 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:41:57.047811 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:41:57.047811 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:41:57.047811 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:41:57.047811 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:41:57.047811 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:41:57.047811 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:41:57.047811 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:41:57.047811 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:41:57.048789 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:41:57.048789 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:41:57.048789 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:41:57.048789 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:41:57.048789 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:41:57.048789 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:41:57.048789 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:41:57.048789 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:41:57.048789 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:41:57.048789 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:41:57.048789 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:41:57.048789 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:41:57.048789 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:41:57.048789 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:41:57.048789 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:41:57.048789 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:41:57.049630 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:41:57.049630 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:41:57.049630 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:41:57.049630 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:41:57.049630 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:41:57.049630 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:41:57.049630 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:41:57.049630 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:41:57.049630 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:41:57.049630 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:41:57.049630 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 18 00:41:57.049630 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:41:57.052578 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 54/108] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Sep 18 00:41:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 00:41:57.063246 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d128eb6-9400-4f24-ab6a-6d3fc441f38b None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:57.137764 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a92fef-d5a5-4d69-bd61-ffed496d8357 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:57.176847 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:41:57.186654 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d128eb6-9400-4f24-ab6a-6d3fc441f38b None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:57.225037 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280bef3b-fa53-461b-95aa-f70e5fc991fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:57.225930 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280bef3b-fa53-461b-95aa-f70e5fc991fc None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:57.226453 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280bef3b-fa53-461b-95aa-f70e5fc991fc None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:57.226941 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280bef3b-fa53-461b-95aa-f70e5fc991fc None admin] PATH_INFO: `/v3/roles` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:57.227831 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280bef3b-fa53-461b-95aa-f70e5fc991fc None admin] RBAC: Adding query filter params (name=member) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:41:57.228373 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280bef3b-fa53-461b-95aa-f70e5fc991fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:41:57.230151 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280bef3b-fa53-461b-95aa-f70e5fc991fc None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:41:57.240227 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 55/109] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Sep 18 00:41:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:41:57.245264 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864089c8-e717-4c81-965c-d02bf9737bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:57.246436 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864089c8-e717-4c81-965c-d02bf9737bc1 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:57.246909 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864089c8-e717-4c81-965c-d02bf9737bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:57.247395 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864089c8-e717-4c81-965c-d02bf9737bc1 None admin] PATH_INFO: `/v3/users/4960cbbfbe784c4086adb3376322e064` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:57.249532 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280bef3b-fa53-461b-95aa-f70e5fc991fc None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:57.284891 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864089c8-e717-4c81-965c-d02bf9737bc1 None admin] RBAC: Authorizing `identity:get_user(user_id=4960cbbfbe784c4086adb3376322e064)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:41:57.286770 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864089c8-e717-4c81-965c-d02bf9737bc1 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:41:57.296494 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 55/110] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Sep 18 00:41:56 2022] GET /identity/v3/users/4960cbbfbe784c4086adb3376322e064 => generated 289 bytes in 456 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:41:57.297855 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864089c8-e717-4c81-965c-d02bf9737bc1 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:57.439149 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280bef3b-fa53-461b-95aa-f70e5fc991fc None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:57.481330 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b6f6b-11b2-4889-8653-dc2683fe6980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:57.482340 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b6f6b-11b2-4889-8653-dc2683fe6980 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:57.482820 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b6f6b-11b2-4889-8653-dc2683fe6980 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:57.483313 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b6f6b-11b2-4889-8653-dc2683fe6980 None admin] PATH_INFO: `/v3/users/1c01447d95d54e7ba8fab62b6917c9ae` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:57.484719 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7b6f6b-11b2-4889-8653-dc2683fe6980 None admin] RBAC: Authorizing `identity:get_user(user_id=1c01447d95d54e7ba8fab62b6917c9ae)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:41:57.486370 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7b6f6b-11b2-4889-8653-dc2683fe6980 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:41:57.488510 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 56/111] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Sep 18 00:41:57 2022] GET /identity/v3/users/1c01447d95d54e7ba8fab62b6917c9ae => generated 275 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:41:57.505214 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb2747d-6dab-47be-a235-5ca4e7ab7487 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:57.505942 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb2747d-6dab-47be-a235-5ca4e7ab7487 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:57.506420 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb2747d-6dab-47be-a235-5ca4e7ab7487 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:57.507996 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 57/112] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:41:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 18 00:41:57.512926 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb2747d-6dab-47be-a235-5ca4e7ab7487 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:57.545212 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:41:57.554960 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:41:57.568695 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864089c8-e717-4c81-965c-d02bf9737bc1 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:57.643452 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df00f0e-ef5e-4c00-963f-636651b2b99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:57.644537 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df00f0e-ef5e-4c00-963f-636651b2b99d None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:57.645101 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df00f0e-ef5e-4c00-963f-636651b2b99d None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:57.645582 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df00f0e-ef5e-4c00-963f-636651b2b99d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:57.681035 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb2747d-6dab-47be-a235-5ca4e7ab7487 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:57.742418 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec2fff1-bcd9-4f11-b48d-d705ca242812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:57.743334 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2fff1-bcd9-4f11-b48d-d705ca242812 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:57.743768 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2fff1-bcd9-4f11-b48d-d705ca242812 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:57.744217 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2fff1-bcd9-4f11-b48d-d705ca242812 None admin] PATH_INFO: `/v3/projects/71680fa1985e4fc4a5c1a73f87753f66` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:57.745938 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec2fff1-bcd9-4f11-b48d-d705ca242812 None admin] RBAC: Authorizing `identity:get_project(project_id=71680fa1985e4fc4a5c1a73f87753f66)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:41:57.748400 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec2fff1-bcd9-4f11-b48d-d705ca242812 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:41:57.750666 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 58/113] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Sep 18 00:41:57 2022] GET /identity/v3/projects/71680fa1985e4fc4a5c1a73f87753f66 => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:41:57.760825 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1fabe-73fe-481d-acb5-a290bb33a50c None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:57.761446 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1fabe-73fe-481d-acb5-a290bb33a50c None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:57.762645 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1fabe-73fe-481d-acb5-a290bb33a50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:57.773673 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df00f0e-ef5e-4c00-963f-636651b2b99d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:41:57.777315 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df00f0e-ef5e-4c00-963f-636651b2b99d None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:41:57.799943 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-56f1fabe-73fe-481d-acb5-a290bb33a50c None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:41:57.802316 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-56f1fabe-73fe-481d-acb5-a290bb33a50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:41:57.960967 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 59/114] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:41:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 00:41:57.963986 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1c521-6206-4242-8f34-2daf4aa6d436 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:57.964757 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1c521-6206-4242-8f34-2daf4aa6d436 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:57.965478 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1c521-6206-4242-8f34-2daf4aa6d436 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:57.968401 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 60/115] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:41:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:41:57.970147 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a1c521-6206-4242-8f34-2daf4aa6d436 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:57.976838 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:41:57.999977 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 56/116] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Sep 18 00:41:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 702 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 00:41:58.002431 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5cffa8-26f0-4deb-a0a1-ce76a0f3c7c3 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:58.002953 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5cffa8-26f0-4deb-a0a1-ce76a0f3c7c3 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:58.003466 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5cffa8-26f0-4deb-a0a1-ce76a0f3c7c3 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:58.007759 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 57/117] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:41:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:41:58.010112 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd6b7f-b385-4bf7-bd41-00968c5971f1 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:58.010789 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd6b7f-b385-4bf7-bd41-00968c5971f1 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:58.011464 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd6b7f-b385-4bf7-bd41-00968c5971f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:58.015671 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:41:58.053020 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-97fd6b7f-b385-4bf7-bd41-00968c5971f1 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:41:58.057770 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-97fd6b7f-b385-4bf7-bd41-00968c5971f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:41:58.197128 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a1c521-6206-4242-8f34-2daf4aa6d436 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:58.213281 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 58/118] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:41:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 00:41:58.217617 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fd6b7f-b385-4bf7-bd41-00968c5971f1 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:58.265744 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784aeb44-37cf-4463-a28f-21c79e45e79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:58.267124 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784aeb44-37cf-4463-a28f-21c79e45e79a None admin] REQUEST_METHOD: `PUT` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:58.267610 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784aeb44-37cf-4463-a28f-21c79e45e79a None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:58.268123 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784aeb44-37cf-4463-a28f-21c79e45e79a None admin] PATH_INFO: `/v3/projects/71680fa1985e4fc4a5c1a73f87753f66/users/1c01447d95d54e7ba8fab62b6917c9ae/roles/59d7218a321b4c20bc1996494a48a2a1` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:58.270520 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784aeb44-37cf-4463-a28f-21c79e45e79a None admin] RBAC: Authorizing `identity:create_grant(project_id=71680fa1985e4fc4a5c1a73f87753f66, user_id=1c01447d95d54e7ba8fab62b6917c9ae, role_id=59d7218a321b4c20bc1996494a48a2a1)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:41:58.272787 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784aeb44-37cf-4463-a28f-21c79e45e79a None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:41:58.292064 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 61/119] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Sep 18 00:41:57 2022] PUT /identity/v3/projects/71680fa1985e4fc4a5c1a73f87753f66/users/1c01447d95d54e7ba8fab62b6917c9ae/roles/59d7218a321b4c20bc1996494a48a2a1 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 00:41:58.293770 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc8791-799a-408c-a42a-3636abb536a4 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:58.294301 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc8791-799a-408c-a42a-3636abb536a4 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:58.294815 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc8791-799a-408c-a42a-3636abb536a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:58.316495 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-01fc8791-799a-408c-a42a-3636abb536a4 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:41:58.318374 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-01fc8791-799a-408c-a42a-3636abb536a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:41:58.401490 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 62/120] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:41:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 00:41:58.402763 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fc8791-799a-408c-a42a-3636abb536a4 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:58.412647 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:41:58.525832 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fc8791-799a-408c-a42a-3636abb536a4 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:58.548036 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fd6b7f-b385-4bf7-bd41-00968c5971f1 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:58.617673 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:41:58.619053 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b5c70-b80f-4bb6-b90f-d66a749e8a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:58.621513 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b5c70-b80f-4bb6-b90f-d66a749e8a24 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:58.622829 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b5c70-b80f-4bb6-b90f-d66a749e8a24 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:58.623560 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b5c70-b80f-4bb6-b90f-d66a749e8a24 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:58.658485 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d8813-6a8c-49e0-b13f-518fc3488c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:58.660514 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d8813-6a8c-49e0-b13f-518fc3488c41 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:58.661738 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248b5c70-b80f-4bb6-b90f-d66a749e8a24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:41:58.662411 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d8813-6a8c-49e0-b13f-518fc3488c41 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:58.662897 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d8813-6a8c-49e0-b13f-518fc3488c41 None admin] PATH_INFO: `/v3/projects/71680fa1985e4fc4a5c1a73f87753f66` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:58.667018 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2d8813-6a8c-49e0-b13f-518fc3488c41 None admin] RBAC: Authorizing `identity:get_project(project_id=71680fa1985e4fc4a5c1a73f87753f66)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:41:58.670479 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2d8813-6a8c-49e0-b13f-518fc3488c41 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:41:58.679027 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 59/121] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Sep 18 00:41:58 2022] GET /identity/v3/projects/71680fa1985e4fc4a5c1a73f87753f66 => generated 298 bytes in 462 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:41:58.679700 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-248b5c70-b80f-4bb6-b90f-d66a749e8a24 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 18 00:41:58.679700 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:41:58.679700 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:41:58.679700 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:41:58.679700 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:41:58.679700 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:41:58.679700 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:41:58.679700 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:41:58.679700 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:41:58.679700 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:41:58.679700 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:41:58.679700 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:41:58.679700 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:41:58.679700 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:41:58.679700 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:41:58.679700 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:41:58.680554 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:41:58.680554 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:41:58.680554 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:41:58.680554 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:41:58.680554 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:41:58.680554 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:41:58.680554 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:41:58.680554 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:41:58.680554 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:41:58.680554 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:41:58.680554 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:41:58.680554 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:41:58.680554 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:41:58.680554 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:41:58.680554 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:41:58.680554 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:41:58.681310 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:41:58.681310 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:41:58.681310 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:41:58.681310 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:41:58.681310 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:41:58.681310 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:41:58.681310 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:41:58.681310 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:41:58.681310 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:41:58.681310 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:41:58.681310 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 18 00:41:58.681310 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:41:58.688420 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 63/122] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Sep 18 00:41:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:41:58.696410 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d8813-6a8c-49e0-b13f-518fc3488c41 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:58.698542 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b5c70-b80f-4bb6-b90f-d66a749e8a24 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:58.808895 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:41:58.910161 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b5c70-b80f-4bb6-b90f-d66a749e8a24 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:58.961764 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d8813-6a8c-49e0-b13f-518fc3488c41 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:59.029843 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e41312-6114-48e6-aed7-a15dc824af27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:59.030912 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e41312-6114-48e6-aed7-a15dc824af27 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:59.031448 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e41312-6114-48e6-aed7-a15dc824af27 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:59.032101 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e41312-6114-48e6-aed7-a15dc824af27 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:59.033342 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e41312-6114-48e6-aed7-a15dc824af27 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:41:59.033992 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e41312-6114-48e6-aed7-a15dc824af27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:41:59.036652 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e41312-6114-48e6-aed7-a15dc824af27 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:41:59.049386 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce86c72d-a37a-4657-b134-7948fba32863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:59.050029 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86c72d-a37a-4657-b134-7948fba32863 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:59.050315 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86c72d-a37a-4657-b134-7948fba32863 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:59.050600 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86c72d-a37a-4657-b134-7948fba32863 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:59.051345 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce86c72d-a37a-4657-b134-7948fba32863 None admin] RBAC: Adding query filter params (role.id=21a002d535ce432597d9291135265677, scope.project.id=71680fa1985e4fc4a5c1a73f87753f66, user.id=4960cbbfbe784c4086adb3376322e064) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:41:59.051654 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce86c72d-a37a-4657-b134-7948fba32863 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:41:59.053730 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce86c72d-a37a-4657-b134-7948fba32863 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:41:59.054680 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 60/123] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Sep 18 00:41:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:41:59.056520 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e41312-6114-48e6-aed7-a15dc824af27 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:59.066416 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 64/124] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Sep 18 00:41:58 2022] GET /identity/v3/role_assignments?user.id=4960cbbfbe784c4086adb3376322e064&scope.project.id=71680fa1985e4fc4a5c1a73f87753f66&role.id=21a002d535ce432597d9291135265677 => generated 259 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:41:59.067274 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce86c72d-a37a-4657-b134-7948fba32863 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:59.216360 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:41:59.316155 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e41312-6114-48e6-aed7-a15dc824af27 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:59.349269 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce86c72d-a37a-4657-b134-7948fba32863 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:59.400684 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f1133c-8101-4685-ba4d-789c854dc40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:59.401509 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1133c-8101-4685-ba4d-789c854dc40e None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:59.401896 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1133c-8101-4685-ba4d-789c854dc40e None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:59.402274 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1133c-8101-4685-ba4d-789c854dc40e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:59.413954 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:41:59.427349 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e7cfae-e8a3-437f-980a-1af7eb7f5576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:59.428589 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7cfae-e8a3-437f-980a-1af7eb7f5576 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:59.429093 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7cfae-e8a3-437f-980a-1af7eb7f5576 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:59.429666 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7cfae-e8a3-437f-980a-1af7eb7f5576 None admin] PATH_INFO: `/v3/users/1c01447d95d54e7ba8fab62b6917c9ae` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:59.431734 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e7cfae-e8a3-437f-980a-1af7eb7f5576 None admin] RBAC: Authorizing `identity:get_user(user_id=1c01447d95d54e7ba8fab62b6917c9ae)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:41:59.433684 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f1133c-8101-4685-ba4d-789c854dc40e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:41:59.435104 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e7cfae-e8a3-437f-980a-1af7eb7f5576 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:41:59.438694 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 65/125] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Sep 18 00:41:59 2022] GET /identity/v3/users/1c01447d95d54e7ba8fab62b6917c9ae => generated 275 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:41:59.440174 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e7cfae-e8a3-437f-980a-1af7eb7f5576 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:59.460780 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-d5f1133c-8101-4685-ba4d-789c854dc40e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 00:41:59.460780 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:41:59.460780 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:41:59.460780 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:41:59.460780 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:41:59.460780 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:41:59.460780 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:41:59.460780 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:41:59.460780 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:41:59.460780 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:41:59.460780 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:41:59.460780 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:41:59.460780 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:41:59.460780 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:41:59.460780 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:41:59.460780 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:41:59.461700 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:41:59.461700 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:41:59.461700 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:41:59.461700 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:41:59.461700 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:41:59.461700 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:41:59.461700 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:41:59.461700 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:41:59.461700 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:41:59.461700 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:41:59.461700 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:41:59.461700 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:41:59.461700 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:41:59.461700 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:41:59.461700 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:41:59.461700 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:41:59.462442 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:41:59.462442 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:41:59.462442 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:41:59.462442 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:41:59.462442 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:41:59.462442 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:41:59.462442 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:41:59.462442 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:41:59.462442 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:41:59.462442 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:41:59.462442 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 00:41:59.462442 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:41:59.462442 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 61/126] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Sep 18 00:41:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 407 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:41:59.463550 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f1133c-8101-4685-ba4d-789c854dc40e None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:59.667232 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e7cfae-e8a3-437f-980a-1af7eb7f5576 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:59.671462 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f1133c-8101-4685-ba4d-789c854dc40e None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:41:59.700291 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:41:59.721676 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b0a780-236b-41cf-b2f6-18da131aa08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:59.723718 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0a780-236b-41cf-b2f6-18da131aa08f None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:59.724063 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0a780-236b-41cf-b2f6-18da131aa08f None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:59.724383 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0a780-236b-41cf-b2f6-18da131aa08f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:59.745826 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b3560f-e6f6-435c-84af-770713f8a249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:41:59.749360 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3560f-e6f6-435c-84af-770713f8a249 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:41:59.749651 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3560f-e6f6-435c-84af-770713f8a249 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:41:59.749930 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3560f-e6f6-435c-84af-770713f8a249 None admin] PATH_INFO: `/v3/projects/71680fa1985e4fc4a5c1a73f87753f66` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:41:59.751513 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b3560f-e6f6-435c-84af-770713f8a249 None admin] RBAC: Authorizing `identity:get_project(project_id=71680fa1985e4fc4a5c1a73f87753f66)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:41:59.753050 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b3560f-e6f6-435c-84af-770713f8a249 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:41:59.754792 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 62/127] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Sep 18 00:41:59 2022] GET /identity/v3/projects/71680fa1985e4fc4a5c1a73f87753f66 => generated 298 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:41:59.755847 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b0a780-236b-41cf-b2f6-18da131aa08f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:41:59.760568 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b3560f-e6f6-435c-84af-770713f8a249 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:59.763654 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-e3b0a780-236b-41cf-b2f6-18da131aa08f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 18 00:41:59.763654 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:41:59.763654 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:41:59.763654 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:41:59.763654 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:41:59.763654 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:41:59.763654 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:41:59.763654 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:41:59.763654 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:41:59.763654 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:41:59.763654 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:41:59.763654 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:41:59.763654 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:41:59.763654 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:41:59.763654 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:41:59.763654 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:41:59.764674 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:41:59.764674 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:41:59.764674 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:41:59.764674 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:41:59.764674 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:41:59.764674 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:41:59.764674 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:41:59.764674 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:41:59.764674 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:41:59.764674 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:41:59.764674 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:41:59.764674 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:41:59.764674 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:41:59.764674 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:41:59.764674 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:41:59.764674 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:41:59.765518 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:41:59.765518 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:41:59.765518 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:41:59.765518 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:41:59.765518 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:41:59.765518 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:41:59.765518 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:41:59.765518 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:41:59.765518 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:41:59.765518 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:41:59.765518 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 18 00:41:59.765518 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:41:59.765518 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 66/128] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Sep 18 00:41:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:41:59.769465 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b0a780-236b-41cf-b2f6-18da131aa08f None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:41:59.907496 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:41:59.966033 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b0a780-236b-41cf-b2f6-18da131aa08f None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:00.018492 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5628146-709c-403e-977c-1e8eb4ae2e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:00.021575 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5628146-709c-403e-977c-1e8eb4ae2e46 None admin] REQUEST_METHOD: `PUT` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:00.021888 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5628146-709c-403e-977c-1e8eb4ae2e46 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:00.022352 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5628146-709c-403e-977c-1e8eb4ae2e46 None admin] PATH_INFO: `/v3/projects/71680fa1985e4fc4a5c1a73f87753f66/users/1c01447d95d54e7ba8fab62b6917c9ae/roles/e2a7bd363c424c5380514254ad1cc522` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:00.027950 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5628146-709c-403e-977c-1e8eb4ae2e46 None admin] RBAC: Authorizing `identity:create_grant(project_id=71680fa1985e4fc4a5c1a73f87753f66, user_id=1c01447d95d54e7ba8fab62b6917c9ae, role_id=e2a7bd363c424c5380514254ad1cc522)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:00.029607 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5628146-709c-403e-977c-1e8eb4ae2e46 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:00.057043 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 67/129] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Sep 18 00:41:59 2022] PUT /identity/v3/projects/71680fa1985e4fc4a5c1a73f87753f66/users/1c01447d95d54e7ba8fab62b6917c9ae/roles/e2a7bd363c424c5380514254ad1cc522 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 00:42:00.057831 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5628146-709c-403e-977c-1e8eb4ae2e46 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:00.064828 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b3560f-e6f6-435c-84af-770713f8a249 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:00.145634 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e66fdf-d401-4323-8aff-243e0d008078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:00.147255 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e66fdf-d401-4323-8aff-243e0d008078 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:00.147734 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e66fdf-d401-4323-8aff-243e0d008078 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:00.148229 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e66fdf-d401-4323-8aff-243e0d008078 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:00.149405 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e66fdf-d401-4323-8aff-243e0d008078 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:42:00.150922 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e66fdf-d401-4323-8aff-243e0d008078 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:00.153582 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e66fdf-d401-4323-8aff-243e0d008078 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:00.174310 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 63/130] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Sep 18 00:41:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 419 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:00.178432 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12939be-02d5-49ae-8fb1-e6f0d25acb06 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:00.178924 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12939be-02d5-49ae-8fb1-e6f0d25acb06 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:00.179404 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12939be-02d5-49ae-8fb1-e6f0d25acb06 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:00.184269 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 64/131] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:42:00 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:42:00.185651 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12939be-02d5-49ae-8fb1-e6f0d25acb06 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:00.278466 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5628146-709c-403e-977c-1e8eb4ae2e46 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:00.344309 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:00.354114 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:00.397978 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c14a3df-b79c-41d9-ab27-0c47b423dc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:00.399174 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c14a3df-b79c-41d9-ab27-0c47b423dc7e None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:00.399800 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c14a3df-b79c-41d9-ab27-0c47b423dc7e None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:00.401377 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c14a3df-b79c-41d9-ab27-0c47b423dc7e None admin] PATH_INFO: `/v3/roles` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:00.402768 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c14a3df-b79c-41d9-ab27-0c47b423dc7e None admin] RBAC: Adding query filter params (name=member) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:42:00.403685 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c14a3df-b79c-41d9-ab27-0c47b423dc7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:00.406824 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c14a3df-b79c-41d9-ab27-0c47b423dc7e None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:00.429046 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 68/132] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Sep 18 00:42:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:00.434973 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d14ff1-ae9b-4504-a2a4-f562518259b3 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:00.435288 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d14ff1-ae9b-4504-a2a4-f562518259b3 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:00.435518 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d14ff1-ae9b-4504-a2a4-f562518259b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:00.454197 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12939be-02d5-49ae-8fb1-e6f0d25acb06 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:00.465587 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-26d14ff1-ae9b-4504-a2a4-f562518259b3 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:42:00.467594 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-26d14ff1-ae9b-4504-a2a4-f562518259b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:42:00.526440 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e1c858-e0ed-479b-a64f-0a8fa883ec3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:00.527582 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e1c858-e0ed-479b-a64f-0a8fa883ec3b None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:00.528247 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e1c858-e0ed-479b-a64f-0a8fa883ec3b None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:00.528860 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e1c858-e0ed-479b-a64f-0a8fa883ec3b None admin] PATH_INFO: `/v3/users/0f8bf0607941426a8b8271be8b554394` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:00.531256 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e1c858-e0ed-479b-a64f-0a8fa883ec3b None admin] RBAC: Authorizing `identity:get_user(user_id=0f8bf0607941426a8b8271be8b554394)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:00.535219 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e1c858-e0ed-479b-a64f-0a8fa883ec3b None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:00.538304 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 65/133] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Sep 18 00:42:00 2022] GET /identity/v3/users/0f8bf0607941426a8b8271be8b554394 => generated 247 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:00.544036 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e1c858-e0ed-479b-a64f-0a8fa883ec3b None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:00.592515 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 69/134] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:42:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 00:42:00.600022 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d14ff1-ae9b-4504-a2a4-f562518259b3 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:00.859771 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e1c858-e0ed-479b-a64f-0a8fa883ec3b None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:00.889876 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:00.894611 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d14ff1-ae9b-4504-a2a4-f562518259b3 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:00.918003 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:00.960952 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506c335-a7dc-4a80-abca-3d850a1357e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:00.961445 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506c335-a7dc-4a80-abca-3d850a1357e0 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:00.961703 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506c335-a7dc-4a80-abca-3d850a1357e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:00.961931 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506c335-a7dc-4a80-abca-3d850a1357e0 None admin] PATH_INFO: `/v3/users/1c01447d95d54e7ba8fab62b6917c9ae` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:00.963209 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9506c335-a7dc-4a80-abca-3d850a1357e0 None admin] RBAC: Authorizing `identity:get_user(user_id=1c01447d95d54e7ba8fab62b6917c9ae)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:00.964794 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9506c335-a7dc-4a80-abca-3d850a1357e0 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:00.971930 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 66/135] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Sep 18 00:42:00 2022] GET /identity/v3/users/1c01447d95d54e7ba8fab62b6917c9ae => generated 275 bytes in 428 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:00.976266 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506c335-a7dc-4a80-abca-3d850a1357e0 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:00.993711 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f4795-0de1-46ab-9304-8a7c7a3bcbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:00.995341 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f4795-0de1-46ab-9304-8a7c7a3bcbcf None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:00.996137 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f4795-0de1-46ab-9304-8a7c7a3bcbcf None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:00.997011 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f4795-0de1-46ab-9304-8a7c7a3bcbcf None admin] PATH_INFO: `/v3/projects/71680fa1985e4fc4a5c1a73f87753f66` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:01.002799 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623f4795-0de1-46ab-9304-8a7c7a3bcbcf None admin] RBAC: Authorizing `identity:get_project(project_id=71680fa1985e4fc4a5c1a73f87753f66)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:01.006516 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623f4795-0de1-46ab-9304-8a7c7a3bcbcf None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:01.010377 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 70/136] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Sep 18 00:42:00 2022] GET /identity/v3/projects/71680fa1985e4fc4a5c1a73f87753f66 => generated 298 bytes in 417 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:01.019868 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f4795-0de1-46ab-9304-8a7c7a3bcbcf None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:01.225842 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506c335-a7dc-4a80-abca-3d850a1357e0 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:01.270255 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f4795-0de1-46ab-9304-8a7c7a3bcbcf None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:01.293471 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295385a0-a5a9-44de-b2a3-51e2c8d3af11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:01.294649 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295385a0-a5a9-44de-b2a3-51e2c8d3af11 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:01.295137 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295385a0-a5a9-44de-b2a3-51e2c8d3af11 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:01.295622 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295385a0-a5a9-44de-b2a3-51e2c8d3af11 None admin] PATH_INFO: `/v3/projects/dfe5fc7a6d694e58898af7d697d5eb2b` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:01.297914 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295385a0-a5a9-44de-b2a3-51e2c8d3af11 None admin] RBAC: Authorizing `identity:get_project(project_id=dfe5fc7a6d694e58898af7d697d5eb2b)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:01.300795 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295385a0-a5a9-44de-b2a3-51e2c8d3af11 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:01.304748 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 67/137] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Sep 18 00:42:00 2022] GET /identity/v3/projects/dfe5fc7a6d694e58898af7d697d5eb2b => generated 312 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:01.311318 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295385a0-a5a9-44de-b2a3-51e2c8d3af11 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:01.320228 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c1d99-4ce1-4c81-8381-d9c7bd04bdda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:01.320929 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c1d99-4ce1-4c81-8381-d9c7bd04bdda None admin] REQUEST_METHOD: `PUT` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:01.322172 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c1d99-4ce1-4c81-8381-d9c7bd04bdda None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:01.322456 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c1d99-4ce1-4c81-8381-d9c7bd04bdda None admin] PATH_INFO: `/v3/projects/71680fa1985e4fc4a5c1a73f87753f66/users/0f8bf0607941426a8b8271be8b554394/roles/591d4711dc204cf98003c8b7d7558506` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:01.329344 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691c1d99-4ce1-4c81-8381-d9c7bd04bdda None admin] RBAC: Authorizing `identity:create_grant(project_id=71680fa1985e4fc4a5c1a73f87753f66, user_id=0f8bf0607941426a8b8271be8b554394, role_id=591d4711dc204cf98003c8b7d7558506)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:01.330821 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691c1d99-4ce1-4c81-8381-d9c7bd04bdda None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:01.352428 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 71/138] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Sep 18 00:42:01 2022] PUT /identity/v3/projects/71680fa1985e4fc4a5c1a73f87753f66/users/0f8bf0607941426a8b8271be8b554394/roles/591d4711dc204cf98003c8b7d7558506 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 00:42:01.352936 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c1d99-4ce1-4c81-8381-d9c7bd04bdda None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:01.448280 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:01.477467 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:01.588313 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295385a0-a5a9-44de-b2a3-51e2c8d3af11 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:01.627919 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c1d99-4ce1-4c81-8381-d9c7bd04bdda None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:01.636749 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d5edd-8325-478c-aa41-e99a650f7916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:01.637433 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d5edd-8325-478c-aa41-e99a650f7916 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:01.637723 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d5edd-8325-478c-aa41-e99a650f7916 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:01.638006 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d5edd-8325-478c-aa41-e99a650f7916 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:01.644409 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774d5edd-8325-478c-aa41-e99a650f7916 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:01.645928 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774d5edd-8325-478c-aa41-e99a650f7916 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:01.648014 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 68/139] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:42:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:01.661088 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d5edd-8325-478c-aa41-e99a650f7916 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:01.748881 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6934774a-e9ab-4c1e-a78d-7fb65e507506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:01.749480 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934774a-e9ab-4c1e-a78d-7fb65e507506 None admin] REQUEST_METHOD: `PUT` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:01.749764 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934774a-e9ab-4c1e-a78d-7fb65e507506 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:01.750041 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934774a-e9ab-4c1e-a78d-7fb65e507506 None admin] PATH_INFO: `/v3/projects/dfe5fc7a6d694e58898af7d697d5eb2b/users/1c01447d95d54e7ba8fab62b6917c9ae/roles/59d7218a321b4c20bc1996494a48a2a1` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:01.752198 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6934774a-e9ab-4c1e-a78d-7fb65e507506 None admin] RBAC: Authorizing `identity:create_grant(project_id=dfe5fc7a6d694e58898af7d697d5eb2b, user_id=1c01447d95d54e7ba8fab62b6917c9ae, role_id=59d7218a321b4c20bc1996494a48a2a1)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:01.753659 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6934774a-e9ab-4c1e-a78d-7fb65e507506 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:01.784309 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 72/140] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Sep 18 00:42:01 2022] PUT /identity/v3/projects/dfe5fc7a6d694e58898af7d697d5eb2b/users/1c01447d95d54e7ba8fab62b6917c9ae/roles/59d7218a321b4c20bc1996494a48a2a1 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 00:42:01.844024 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d5edd-8325-478c-aa41-e99a650f7916 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:01.861775 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:01.887553 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f83d9e3-38ea-4627-a5c1-5364eac2969e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:01.888278 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83d9e3-38ea-4627-a5c1-5364eac2969e None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:01.888562 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83d9e3-38ea-4627-a5c1-5364eac2969e None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:01.888905 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83d9e3-38ea-4627-a5c1-5364eac2969e None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:01.889695 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f83d9e3-38ea-4627-a5c1-5364eac2969e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:01.891315 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f83d9e3-38ea-4627-a5c1-5364eac2969e None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:01.924951 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 69/141] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Sep 18 00:42:01 2022] POST /identity/v3/users => generated 283 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 00:42:02.036499 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b73713b-5588-458f-94a8-78806af08aa3 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:02.037306 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b73713b-5588-458f-94a8-78806af08aa3 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:02.037887 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b73713b-5588-458f-94a8-78806af08aa3 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:02.039659 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 73/142] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:42:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:42:02.049120 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e849c590-4dd4-4d0a-840b-29889d1cf028 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:02.049579 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e849c590-4dd4-4d0a-840b-29889d1cf028 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:02.050023 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e849c590-4dd4-4d0a-840b-29889d1cf028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:02.092789 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-e849c590-4dd4-4d0a-840b-29889d1cf028 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:42:02.094956 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-e849c590-4dd4-4d0a-840b-29889d1cf028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:42:02.275249 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 70/143] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:42:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 00:42:02.680124 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def4a44-b41d-437c-8d65-14c29ef825cb None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:02.681353 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def4a44-b41d-437c-8d65-14c29ef825cb None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:02.681853 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def4a44-b41d-437c-8d65-14c29ef825cb None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:02.683883 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 74/144] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:42:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:42:02.692206 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac2f4f-1c28-48ae-8166-59157d1b74bf None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:02.692698 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac2f4f-1c28-48ae-8166-59157d1b74bf None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:02.693228 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac2f4f-1c28-48ae-8166-59157d1b74bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:02.733319 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-6aac2f4f-1c28-48ae-8166-59157d1b74bf None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:42:02.735201 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-6aac2f4f-1c28-48ae-8166-59157d1b74bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:42:02.903782 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 71/145] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:42:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 00:42:02.989539 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def4a44-b41d-437c-8d65-14c29ef825cb None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:03.182636 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:03.194328 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def4a44-b41d-437c-8d65-14c29ef825cb None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:03.295429 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b163c20-46ed-4db3-b818-2a67d95ad04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:03.296389 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b163c20-46ed-4db3-b818-2a67d95ad04d None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:03.296884 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b163c20-46ed-4db3-b818-2a67d95ad04d None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:03.297369 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b163c20-46ed-4db3-b818-2a67d95ad04d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:03.325601 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b163c20-46ed-4db3-b818-2a67d95ad04d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:42:03.340297 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-9b163c20-46ed-4db3-b818-2a67d95ad04d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 18 00:42:03.340297 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:42:03.340297 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:42:03.340297 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:42:03.340297 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:42:03.340297 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:42:03.340297 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:42:03.340297 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:42:03.340297 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:42:03.340297 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:42:03.340297 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:42:03.340297 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:42:03.340297 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:42:03.340297 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:42:03.340297 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:42:03.340297 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:42:03.342148 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:42:03.342148 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:42:03.342148 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:42:03.342148 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:42:03.342148 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:42:03.342148 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:42:03.342148 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:42:03.342148 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:42:03.342148 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:42:03.342148 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:42:03.342148 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:42:03.342148 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:42:03.342148 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:42:03.342148 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:42:03.342148 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:42:03.342148 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:42:03.344153 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:42:03.344153 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:42:03.344153 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:42:03.344153 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:42:03.344153 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:42:03.344153 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:42:03.344153 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:42:03.344153 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:42:03.344153 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:42:03.344153 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:42:03.344153 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 18 00:42:03.344153 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:42:03.344153 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 75/146] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Sep 18 00:42:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:42:03.357794 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aac2f4f-1c28-48ae-8166-59157d1b74bf None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:03.426737 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:03.547263 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aac2f4f-1c28-48ae-8166-59157d1b74bf None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:03.594854 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c516b339-ac27-488b-b15a-548f98635203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:03.595534 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516b339-ac27-488b-b15a-548f98635203 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:03.595822 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516b339-ac27-488b-b15a-548f98635203 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:03.596153 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516b339-ac27-488b-b15a-548f98635203 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:03.596869 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c516b339-ac27-488b-b15a-548f98635203 None admin] RBAC: Adding query filter params (name=member) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:42:03.597191 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c516b339-ac27-488b-b15a-548f98635203 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:03.598632 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c516b339-ac27-488b-b15a-548f98635203 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:03.608479 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 72/147] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Sep 18 00:42:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:03.620331 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b163c20-46ed-4db3-b818-2a67d95ad04d None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:03.713613 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c516b339-ac27-488b-b15a-548f98635203 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:03.867111 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b163c20-46ed-4db3-b818-2a67d95ad04d None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:03.891860 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:03.910902 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c516b339-ac27-488b-b15a-548f98635203 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:03.976840 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b12b0f-414d-48f3-aa7e-609e7b682b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:03.977585 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b12b0f-414d-48f3-aa7e-609e7b682b88 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:03.977833 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ec780d-4683-4ade-a827-7fa587ae641b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:03.977984 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b12b0f-414d-48f3-aa7e-609e7b682b88 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:03.978249 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b12b0f-414d-48f3-aa7e-609e7b682b88 None admin] PATH_INFO: `/v3/users/1c01447d95d54e7ba8fab62b6917c9ae` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:03.978512 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec780d-4683-4ade-a827-7fa587ae641b None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:03.978824 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec780d-4683-4ade-a827-7fa587ae641b None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:03.979073 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec780d-4683-4ade-a827-7fa587ae641b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:03.979475 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b12b0f-414d-48f3-aa7e-609e7b682b88 None admin] RBAC: Authorizing `identity:get_user(user_id=1c01447d95d54e7ba8fab62b6917c9ae)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:03.981017 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b12b0f-414d-48f3-aa7e-609e7b682b88 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:03.982744 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 76/148] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Sep 18 00:42:03 2022] GET /identity/v3/users/1c01447d95d54e7ba8fab62b6917c9ae => generated 275 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:03.991866 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b12b0f-414d-48f3-aa7e-609e7b682b88 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:03.999717 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ec780d-4683-4ade-a827-7fa587ae641b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:42:04.010140 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-b7ec780d-4683-4ade-a827-7fa587ae641b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 18 00:42:04.010140 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:42:04.010140 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:42:04.010140 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:42:04.010140 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:42:04.010140 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:42:04.010140 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:42:04.010140 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:42:04.010140 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:42:04.010140 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:42:04.010140 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:42:04.010140 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:42:04.010140 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:42:04.010140 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:42:04.010140 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:42:04.010140 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:42:04.012251 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:42:04.012251 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:42:04.012251 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:42:04.012251 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:42:04.012251 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:42:04.012251 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:42:04.012251 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:42:04.012251 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:42:04.012251 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:42:04.012251 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:42:04.012251 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:42:04.012251 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:42:04.012251 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:42:04.012251 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:42:04.012251 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:42:04.012251 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:42:04.014063 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:42:04.014063 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:42:04.014063 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:42:04.014063 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:42:04.014063 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:42:04.014063 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:42:04.014063 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:42:04.014063 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:42:04.014063 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:42:04.014063 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:42:04.014063 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 18 00:42:04.014063 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:42:04.014063 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 73/149] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Sep 18 00:42:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:42:04.021591 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ec780d-4683-4ade-a827-7fa587ae641b None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:04.066568 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:04.274038 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ec780d-4683-4ade-a827-7fa587ae641b None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:04.303129 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b12b0f-414d-48f3-aa7e-609e7b682b88 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:04.385617 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d84ada-5c70-44db-bcbd-3f5e3c19a693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:04.386255 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d84ada-5c70-44db-bcbd-3f5e3c19a693 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:04.386531 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d84ada-5c70-44db-bcbd-3f5e3c19a693 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:04.386800 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d84ada-5c70-44db-bcbd-3f5e3c19a693 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:04.388103 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c0065-b5fe-4091-a4f5-ec5ba80e3b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:04.389561 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c0065-b5fe-4091-a4f5-ec5ba80e3b41 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:04.390456 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c0065-b5fe-4091-a4f5-ec5ba80e3b41 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:04.391278 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c0065-b5fe-4091-a4f5-ec5ba80e3b41 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:04.392763 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066c0065-b5fe-4091-a4f5-ec5ba80e3b41 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:42:04.393592 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066c0065-b5fe-4091-a4f5-ec5ba80e3b41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:04.397504 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066c0065-b5fe-4091-a4f5-ec5ba80e3b41 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:04.423777 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 74/150] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Sep 18 00:42:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:04.431011 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c0065-b5fe-4091-a4f5-ec5ba80e3b41 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:04.467920 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:04.494439 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d84ada-5c70-44db-bcbd-3f5e3c19a693 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:04.495965 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d84ada-5c70-44db-bcbd-3f5e3c19a693 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:04.542966 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:04.691256 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c0065-b5fe-4091-a4f5-ec5ba80e3b41 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:04.747815 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c81d0d-c0ff-484e-a618-0507bbc584b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:04.748990 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c81d0d-c0ff-484e-a618-0507bbc584b1 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:04.749479 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c81d0d-c0ff-484e-a618-0507bbc584b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:04.749959 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c81d0d-c0ff-484e-a618-0507bbc584b1 None admin] PATH_INFO: `/v3/users/4960cbbfbe784c4086adb3376322e064` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:04.751669 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c81d0d-c0ff-484e-a618-0507bbc584b1 None admin] RBAC: Authorizing `identity:get_user(user_id=4960cbbfbe784c4086adb3376322e064)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:04.753930 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c81d0d-c0ff-484e-a618-0507bbc584b1 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:04.756596 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 75/151] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Sep 18 00:42:04 2022] GET /identity/v3/users/4960cbbfbe784c4086adb3376322e064 => generated 289 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:42:04.762377 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c81d0d-c0ff-484e-a618-0507bbc584b1 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:04.784340 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 77/152] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Sep 18 00:42:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 793 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 18 00:42:04.787273 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911235be-4d0e-458f-b52b-d969796cf89c None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:04.787553 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911235be-4d0e-458f-b52b-d969796cf89c None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:04.788062 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911235be-4d0e-458f-b52b-d969796cf89c None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:04.790481 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 78/153] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:42:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:42:04.797762 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911235be-4d0e-458f-b52b-d969796cf89c None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:04.914063 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:04.991780 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c81d0d-c0ff-484e-a618-0507bbc584b1 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:05.135018 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec456bc4-d431-47b4-ab64-6587fb61518a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:05.136055 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec456bc4-d431-47b4-ab64-6587fb61518a None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:05.136553 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec456bc4-d431-47b4-ab64-6587fb61518a None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:05.137034 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec456bc4-d431-47b4-ab64-6587fb61518a None admin] PATH_INFO: `/v3/projects/71680fa1985e4fc4a5c1a73f87753f66` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:05.139015 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec456bc4-d431-47b4-ab64-6587fb61518a None admin] RBAC: Authorizing `identity:get_project(project_id=71680fa1985e4fc4a5c1a73f87753f66)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:05.141687 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec456bc4-d431-47b4-ab64-6587fb61518a None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:05.144881 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 76/154] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Sep 18 00:42:04 2022] GET /identity/v3/projects/71680fa1985e4fc4a5c1a73f87753f66 => generated 298 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:42:05.147525 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d56ff-da2f-488e-88dd-42e3318fe6da None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:05.150043 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d56ff-da2f-488e-88dd-42e3318fe6da None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:05.150568 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d56ff-da2f-488e-88dd-42e3318fe6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:05.182447 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911235be-4d0e-458f-b52b-d969796cf89c None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:05.220714 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-124d56ff-da2f-488e-88dd-42e3318fe6da None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:42:05.222962 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-124d56ff-da2f-488e-88dd-42e3318fe6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:42:05.259801 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:05.278235 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c576a3c-0eaa-4c83-8f56-fbf00e15517f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:05.279022 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c576a3c-0eaa-4c83-8f56-fbf00e15517f None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:05.279310 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c576a3c-0eaa-4c83-8f56-fbf00e15517f None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:05.279586 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c576a3c-0eaa-4c83-8f56-fbf00e15517f None admin] PATH_INFO: `/v3/projects/71680fa1985e4fc4a5c1a73f87753f66` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:05.284707 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c576a3c-0eaa-4c83-8f56-fbf00e15517f None admin] RBAC: Authorizing `identity:get_project(project_id=71680fa1985e4fc4a5c1a73f87753f66)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:05.286214 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c576a3c-0eaa-4c83-8f56-fbf00e15517f None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:05.288626 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 79/155] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Sep 18 00:42:04 2022] GET /identity/v3/projects/71680fa1985e4fc4a5c1a73f87753f66 => generated 298 bytes in 492 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:05.289428 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c576a3c-0eaa-4c83-8f56-fbf00e15517f None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:05.479016 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 77/156] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:42:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 00:42:05.480543 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124d56ff-da2f-488e-88dd-42e3318fe6da None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:05.530746 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c576a3c-0eaa-4c83-8f56-fbf00e15517f None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:05.627642 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5121076-41eb-4fd6-85c4-59259d82422b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:05.628301 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5121076-41eb-4fd6-85c4-59259d82422b None admin] REQUEST_METHOD: `PUT` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:05.628581 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5121076-41eb-4fd6-85c4-59259d82422b None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:05.628854 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5121076-41eb-4fd6-85c4-59259d82422b None admin] PATH_INFO: `/v3/projects/71680fa1985e4fc4a5c1a73f87753f66/users/4960cbbfbe784c4086adb3376322e064/roles/21a002d535ce432597d9291135265677` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:05.633383 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5121076-41eb-4fd6-85c4-59259d82422b None admin] RBAC: Authorizing `identity:create_grant(project_id=71680fa1985e4fc4a5c1a73f87753f66, user_id=4960cbbfbe784c4086adb3376322e064, role_id=21a002d535ce432597d9291135265677)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:05.634914 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5121076-41eb-4fd6-85c4-59259d82422b None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:05.661803 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 80/157] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Sep 18 00:42:05 2022] PUT /identity/v3/projects/71680fa1985e4fc4a5c1a73f87753f66/users/4960cbbfbe784c4086adb3376322e064/roles/21a002d535ce432597d9291135265677 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 00:42:05.751775 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:05.800946 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124d56ff-da2f-488e-88dd-42e3318fe6da None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:05.889783 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061b0014-8fe7-4866-a17a-5d1f18fd8b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:05.890825 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b0014-8fe7-4866-a17a-5d1f18fd8b03 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:05.891315 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b0014-8fe7-4866-a17a-5d1f18fd8b03 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:05.891855 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b0014-8fe7-4866-a17a-5d1f18fd8b03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:05.893257 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061b0014-8fe7-4866-a17a-5d1f18fd8b03 None admin] RBAC: Adding query filter params (role.id=59d7218a321b4c20bc1996494a48a2a1, scope.project.id=71680fa1985e4fc4a5c1a73f87753f66, user.id=1c01447d95d54e7ba8fab62b6917c9ae) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:42:05.893735 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061b0014-8fe7-4866-a17a-5d1f18fd8b03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:05.897099 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061b0014-8fe7-4866-a17a-5d1f18fd8b03 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:05.908203 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 78/158] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Sep 18 00:42:05 2022] GET /identity/v3/role_assignments?user.id=1c01447d95d54e7ba8fab62b6917c9ae&scope.project.id=71680fa1985e4fc4a5c1a73f87753f66&role.id=59d7218a321b4c20bc1996494a48a2a1 => generated 608 bytes in 429 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:06.410058 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb1498-fc33-48f1-8fc3-2433b414b816 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:06.410838 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb1498-fc33-48f1-8fc3-2433b414b816 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:06.410838 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb1498-fc33-48f1-8fc3-2433b414b816 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:06.412436 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 81/159] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:42:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:42:06.419355 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcdd5de-9931-4aeb-bfa4-9ae576b3cabf None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:06.420789 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcdd5de-9931-4aeb-bfa4-9ae576b3cabf None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:06.421565 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcdd5de-9931-4aeb-bfa4-9ae576b3cabf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:06.460292 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-9bcdd5de-9931-4aeb-bfa4-9ae576b3cabf None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:42:06.462679 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-9bcdd5de-9931-4aeb-bfa4-9ae576b3cabf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:42:06.514600 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb1498-fc33-48f1-8fc3-2433b414b816 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:06.632555 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 79/160] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:42:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 00:42:06.641358 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:06.703626 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb1498-fc33-48f1-8fc3-2433b414b816 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:06.741234 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45525de6-9f4c-45d6-b5e5-cdac3489cf84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:06.742230 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45525de6-9f4c-45d6-b5e5-cdac3489cf84 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:06.742727 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45525de6-9f4c-45d6-b5e5-cdac3489cf84 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:06.743206 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45525de6-9f4c-45d6-b5e5-cdac3489cf84 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:06.760021 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45525de6-9f4c-45d6-b5e5-cdac3489cf84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:42:06.765221 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-45525de6-9f4c-45d6-b5e5-cdac3489cf84 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 18 00:42:06.765221 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:42:06.765221 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:42:06.765221 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:42:06.765221 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:42:06.765221 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:42:06.765221 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:42:06.765221 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:42:06.765221 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:42:06.765221 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:42:06.765221 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:42:06.765221 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:42:06.765221 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:42:06.765221 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:42:06.765221 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:42:06.765221 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:42:06.766064 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:42:06.766064 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:42:06.766064 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:42:06.766064 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:42:06.766064 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:42:06.766064 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:42:06.766064 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:42:06.766064 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:42:06.766064 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:42:06.766064 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:42:06.766064 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:42:06.766064 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:42:06.766064 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:42:06.766064 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:42:06.766064 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:42:06.766064 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:42:06.766797 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:42:06.766797 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:42:06.766797 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:42:06.766797 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:42:06.766797 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:42:06.766797 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:42:06.766797 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:42:06.766797 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:42:06.766797 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:42:06.766797 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:42:06.766797 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 18 00:42:06.766797 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:42:06.769097 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 82/161] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Sep 18 00:42:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 00:42:06.778542 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcdd5de-9931-4aeb-bfa4-9ae576b3cabf None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:06.964854 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:07.016892 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcdd5de-9931-4aeb-bfa4-9ae576b3cabf None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:07.088916 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce09cd-9161-44a3-9975-de583d7f1dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:07.089946 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce09cd-9161-44a3-9975-de583d7f1dd4 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:07.090442 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce09cd-9161-44a3-9975-de583d7f1dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:07.090949 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce09cd-9161-44a3-9975-de583d7f1dd4 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:07.092221 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ce09cd-9161-44a3-9975-de583d7f1dd4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:42:07.092777 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ce09cd-9161-44a3-9975-de583d7f1dd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:07.095282 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ce09cd-9161-44a3-9975-de583d7f1dd4 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:07.122396 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 80/162] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Sep 18 00:42:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:07.131219 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45525de6-9f4c-45d6-b5e5-cdac3489cf84 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:07.191872 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be6ef3-4a45-40b8-a119-04a6c08ded70 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:07.192404 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be6ef3-4a45-40b8-a119-04a6c08ded70 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:07.192980 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be6ef3-4a45-40b8-a119-04a6c08ded70 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:07.196176 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 81/163] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:42:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:42:07.204800 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae86173-d693-4a29-ba4c-10967530bb7c None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:07.205297 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae86173-d693-4a29-ba4c-10967530bb7c None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:07.205790 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae86173-d693-4a29-ba4c-10967530bb7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:07.255706 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-aae86173-d693-4a29-ba4c-10967530bb7c None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:42:07.257792 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-aae86173-d693-4a29-ba4c-10967530bb7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:42:07.343108 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45525de6-9f4c-45d6-b5e5-cdac3489cf84 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:07.376411 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:07.429981 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21008988-f63c-4bfd-8a62-288696fbda53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:07.430640 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21008988-f63c-4bfd-8a62-288696fbda53 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:07.430904 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21008988-f63c-4bfd-8a62-288696fbda53 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:07.431177 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21008988-f63c-4bfd-8a62-288696fbda53 None admin] PATH_INFO: `/v3/users/1c01447d95d54e7ba8fab62b6917c9ae` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:07.432462 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21008988-f63c-4bfd-8a62-288696fbda53 None admin] RBAC: Authorizing `identity:get_user(user_id=1c01447d95d54e7ba8fab62b6917c9ae)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:07.433940 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21008988-f63c-4bfd-8a62-288696fbda53 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:07.435831 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 83/164] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Sep 18 00:42:07 2022] GET /identity/v3/users/1c01447d95d54e7ba8fab62b6917c9ae => generated 275 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:07.436481 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21008988-f63c-4bfd-8a62-288696fbda53 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:07.467804 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 82/165] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:42:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 18 00:42:07.469404 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae86173-d693-4a29-ba4c-10967530bb7c None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:07.640451 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:07.704090 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21008988-f63c-4bfd-8a62-288696fbda53 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:07.708778 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae86173-d693-4a29-ba4c-10967530bb7c None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:07.782685 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab319e55-5369-43fd-9316-c3a051e5f61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:07.783783 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab319e55-5369-43fd-9316-c3a051e5f61a None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:07.784295 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab319e55-5369-43fd-9316-c3a051e5f61a None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:07.784788 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab319e55-5369-43fd-9316-c3a051e5f61a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:07.785196 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3609d924-6503-43c5-a3f4-b89535def159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:07.788789 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3609d924-6503-43c5-a3f4-b89535def159 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:07.788789 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3609d924-6503-43c5-a3f4-b89535def159 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:07.788789 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3609d924-6503-43c5-a3f4-b89535def159 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:07.811117 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3609d924-6503-43c5-a3f4-b89535def159 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:42:07.816173 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-3609d924-6503-43c5-a3f4-b89535def159 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 00:42:07.816173 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:42:07.816173 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:42:07.816173 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:42:07.816173 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:42:07.816173 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:42:07.816173 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:42:07.816173 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:42:07.816173 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:42:07.816173 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:42:07.816173 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:42:07.816173 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:42:07.816173 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:42:07.816173 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:42:07.816173 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:42:07.816173 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:42:07.817159 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:42:07.817159 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:42:07.817159 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:42:07.817159 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:42:07.817159 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:42:07.817159 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:42:07.817159 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:42:07.817159 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:42:07.817159 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:42:07.817159 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:42:07.817159 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:42:07.817159 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:42:07.817159 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:42:07.817159 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:42:07.817159 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:42:07.817159 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:42:07.819033 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:42:07.819033 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:42:07.819033 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:42:07.819033 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:42:07.819033 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:42:07.819033 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:42:07.819033 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:42:07.819033 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:42:07.819033 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:42:07.819033 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:42:07.819033 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 00:42:07.819033 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:42:07.819033 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 84/166] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Sep 18 00:42:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:42:07.819676 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0eb3f-48f6-4b61-8228-ceee54c1a70b None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:07.819676 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0eb3f-48f6-4b61-8228-ceee54c1a70b None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:07.819676 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0eb3f-48f6-4b61-8228-ceee54c1a70b None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:07.820936 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 85/167] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:42:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:42:07.827381 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c0eb3f-48f6-4b61-8228-ceee54c1a70b None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:07.916925 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:07.929134 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab319e55-5369-43fd-9316-c3a051e5f61a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:07.930997 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab319e55-5369-43fd-9316-c3a051e5f61a None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:08.044945 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c0eb3f-48f6-4b61-8228-ceee54c1a70b None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:08.050897 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:08.124676 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d0c355-1607-48e5-b535-9fad1565da43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:08.125317 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0c355-1607-48e5-b535-9fad1565da43 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:08.125596 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0c355-1607-48e5-b535-9fad1565da43 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:08.125868 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0c355-1607-48e5-b535-9fad1565da43 None admin] PATH_INFO: `/v3/roles` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:08.127309 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d0c355-1607-48e5-b535-9fad1565da43 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:42:08.127611 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d0c355-1607-48e5-b535-9fad1565da43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:08.129065 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d0c355-1607-48e5-b535-9fad1565da43 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:08.133629 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 83/168] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Sep 18 00:42:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 665 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 00:42:08.134988 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef235f-85de-4bc5-abb8-a52d8e881031 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:08.135272 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef235f-85de-4bc5-abb8-a52d8e881031 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:08.135554 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef235f-85de-4bc5-abb8-a52d8e881031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:08.152186 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 86/169] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Sep 18 00:42:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:42:08.153084 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d0c355-1607-48e5-b535-9fad1565da43 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:08.176091 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-b2ef235f-85de-4bc5-abb8-a52d8e881031 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:42:08.179921 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-b2ef235f-85de-4bc5-abb8-a52d8e881031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:42:08.307724 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 84/170] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:42:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 00:42:08.309237 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ef235f-85de-4bc5-abb8-a52d8e881031 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:08.321833 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d0c355-1607-48e5-b535-9fad1565da43 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:08.324866 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:08.366605 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab268b-d0a8-4e4c-a3a0-d75fc02a3711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:08.367276 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab268b-d0a8-4e4c-a3a0-d75fc02a3711 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:08.367562 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab268b-d0a8-4e4c-a3a0-d75fc02a3711 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:08.367831 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab268b-d0a8-4e4c-a3a0-d75fc02a3711 None admin] PATH_INFO: `/v3/projects/71680fa1985e4fc4a5c1a73f87753f66` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:08.369226 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ab268b-d0a8-4e4c-a3a0-d75fc02a3711 None admin] RBAC: Authorizing `identity:get_project(project_id=71680fa1985e4fc4a5c1a73f87753f66)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:08.371082 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ab268b-d0a8-4e4c-a3a0-d75fc02a3711 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:08.372967 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 87/171] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Sep 18 00:42:08 2022] GET /identity/v3/projects/71680fa1985e4fc4a5c1a73f87753f66 => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:08.373809 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab268b-d0a8-4e4c-a3a0-d75fc02a3711 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:08.557900 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:08.572084 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab268b-d0a8-4e4c-a3a0-d75fc02a3711 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:08.573034 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ef235f-85de-4bc5-abb8-a52d8e881031 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:08.628000 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19e2438-1642-4ed8-a2ae-98b8dfadbf4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:08.629348 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e2438-1642-4ed8-a2ae-98b8dfadbf4d None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:08.629872 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e2438-1642-4ed8-a2ae-98b8dfadbf4d None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:08.630433 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e2438-1642-4ed8-a2ae-98b8dfadbf4d None admin] PATH_INFO: `/v3/users/0f8bf0607941426a8b8271be8b554394` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:08.633329 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19e2438-1642-4ed8-a2ae-98b8dfadbf4d None admin] RBAC: Authorizing `identity:get_user(user_id=0f8bf0607941426a8b8271be8b554394)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:08.635685 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19e2438-1642-4ed8-a2ae-98b8dfadbf4d None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:08.637830 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 85/172] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Sep 18 00:42:08 2022] GET /identity/v3/users/0f8bf0607941426a8b8271be8b554394 => generated 247 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:08.642805 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4505d691-2a67-4c02-a6d6-54653a8bb6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:08.642805 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505d691-2a67-4c02-a6d6-54653a8bb6cd None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:08.643282 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505d691-2a67-4c02-a6d6-54653a8bb6cd None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:08.643786 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505d691-2a67-4c02-a6d6-54653a8bb6cd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:08.645141 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567ce5f-dcda-4a71-b99c-9fdcb17b6df9 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:08.645670 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567ce5f-dcda-4a71-b99c-9fdcb17b6df9 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:08.649211 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567ce5f-dcda-4a71-b99c-9fdcb17b6df9 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:08.654865 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 86/173] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:42:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:42:08.654865 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4567ce5f-dcda-4a71-b99c-9fdcb17b6df9 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:08.676445 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4505d691-2a67-4c02-a6d6-54653a8bb6cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:42:08.688328 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-4505d691-2a67-4c02-a6d6-54653a8bb6cd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 18 00:42:08.688328 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:42:08.688328 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:42:08.688328 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:42:08.688328 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:42:08.688328 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:42:08.688328 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:42:08.688328 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:42:08.688328 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:42:08.688328 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:42:08.688328 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:42:08.688328 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:42:08.688328 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:42:08.688328 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:42:08.688328 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:42:08.688328 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:42:08.690033 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:42:08.690033 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:42:08.690033 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:42:08.690033 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:42:08.690033 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:42:08.690033 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:42:08.690033 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:42:08.690033 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:42:08.690033 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:42:08.690033 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:42:08.690033 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:42:08.690033 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:42:08.690033 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:42:08.690033 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:42:08.690033 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:42:08.690033 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:42:08.691511 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:42:08.691511 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:42:08.691511 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:42:08.691511 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:42:08.691511 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:42:08.691511 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:42:08.691511 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:42:08.691511 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:42:08.691511 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:42:08.691511 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:42:08.691511 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 18 00:42:08.691511 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:42:08.696516 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 88/174] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Sep 18 00:42:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:42:08.699357 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdb027-bcdf-4e7f-9c1e-db02d27571d8 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:08.700186 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdb027-bcdf-4e7f-9c1e-db02d27571d8 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:08.700964 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdb027-bcdf-4e7f-9c1e-db02d27571d8 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:08.703885 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 89/175] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:42:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:42:08.705862 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbdb027-bcdf-4e7f-9c1e-db02d27571d8 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:08.775602 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:08.901192 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4567ce5f-dcda-4a71-b99c-9fdcb17b6df9 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:08.921189 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbdb027-bcdf-4e7f-9c1e-db02d27571d8 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:08.967011 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbbfd28-4397-4be7-98d1-accdb77e3ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:08.967374 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799be8cf-8fd3-4127-946d-fd89d848e8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:08.967736 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbbfd28-4397-4be7-98d1-accdb77e3ad8 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:08.968107 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbbfd28-4397-4be7-98d1-accdb77e3ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:08.968404 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbbfd28-4397-4be7-98d1-accdb77e3ad8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:08.968553 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799be8cf-8fd3-4127-946d-fd89d848e8c3 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:08.968924 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799be8cf-8fd3-4127-946d-fd89d848e8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:08.969416 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799be8cf-8fd3-4127-946d-fd89d848e8c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:08.970794 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799be8cf-8fd3-4127-946d-fd89d848e8c3 None admin] RBAC: Adding query filter params (role.id=e2a7bd363c424c5380514254ad1cc522, scope.project.id=71680fa1985e4fc4a5c1a73f87753f66, user.id=1c01447d95d54e7ba8fab62b6917c9ae) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:42:08.971349 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799be8cf-8fd3-4127-946d-fd89d848e8c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:08.974720 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799be8cf-8fd3-4127-946d-fd89d848e8c3 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:08.986348 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 87/176] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Sep 18 00:42:08 2022] GET /identity/v3/role_assignments?user.id=1c01447d95d54e7ba8fab62b6917c9ae&scope.project.id=71680fa1985e4fc4a5c1a73f87753f66&role.id=e2a7bd363c424c5380514254ad1cc522 => generated 608 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:08.989016 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f4a6b-0c96-4d76-be21-60c4adbc6b2c None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:08.989522 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f4a6b-0c96-4d76-be21-60c4adbc6b2c None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:08.990316 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f4a6b-0c96-4d76-be21-60c4adbc6b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:09.022869 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-8f0f4a6b-0c96-4d76-be21-60c4adbc6b2c None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:42:09.025097 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-8f0f4a6b-0c96-4d76-be21-60c4adbc6b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:42:09.071678 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:09.081881 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbbfd28-4397-4be7-98d1-accdb77e3ad8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:09.084839 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbbfd28-4397-4be7-98d1-accdb77e3ad8 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:09.135247 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 88/177] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:42:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 00:42:09.144789 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:09.147691 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0f4a6b-0c96-4d76-be21-60c4adbc6b2c None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:09.240389 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 90/178] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Sep 18 00:42:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 00:42:09.242031 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b45311-8cfe-4652-bca2-5849553d1c4b None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:09.242521 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b45311-8cfe-4652-bca2-5849553d1c4b None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:09.242939 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b45311-8cfe-4652-bca2-5849553d1c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:09.300509 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-97b45311-8cfe-4652-bca2-5849553d1c4b None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:42:09.302601 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-97b45311-8cfe-4652-bca2-5849553d1c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:42:09.440132 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0f4a6b-0c96-4d76-be21-60c4adbc6b2c None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:09.482953 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 91/179] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:42:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 00:42:09.484732 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b45311-8cfe-4652-bca2-5849553d1c4b None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:09.546667 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcaab58-4ae6-4e4c-88bc-873350fac3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:09.548096 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcaab58-4ae6-4e4c-88bc-873350fac3ad None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:09.548601 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcaab58-4ae6-4e4c-88bc-873350fac3ad None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:09.549746 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcaab58-4ae6-4e4c-88bc-873350fac3ad None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:09.551388 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcaab58-4ae6-4e4c-88bc-873350fac3ad None admin] RBAC: Adding query filter params (name=member) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:42:09.551937 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcaab58-4ae6-4e4c-88bc-873350fac3ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:09.556843 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcaab58-4ae6-4e4c-88bc-873350fac3ad None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:09.579611 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 89/180] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Sep 18 00:42:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 435 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:09.585638 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcaab58-4ae6-4e4c-88bc-873350fac3ad None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:09.609065 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:09.641802 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:09.672841 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b45311-8cfe-4652-bca2-5849553d1c4b None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:09.716251 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfaf8df-dcd9-415c-9995-f5ccd08776dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:09.717272 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfaf8df-dcd9-415c-9995-f5ccd08776dd None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:09.717751 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfaf8df-dcd9-415c-9995-f5ccd08776dd None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:09.718289 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfaf8df-dcd9-415c-9995-f5ccd08776dd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:09.732674 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfaf8df-dcd9-415c-9995-f5ccd08776dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:42:09.738346 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-6bfaf8df-dcd9-415c-9995-f5ccd08776dd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 00:42:09.738346 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:42:09.738346 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:42:09.738346 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:42:09.738346 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:42:09.738346 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:42:09.738346 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:42:09.738346 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:42:09.738346 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:42:09.738346 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:42:09.738346 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:42:09.738346 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:42:09.738346 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:42:09.738346 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:42:09.738346 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:42:09.738346 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:42:09.739287 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:42:09.739287 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:42:09.739287 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:42:09.739287 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:42:09.739287 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:42:09.739287 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:42:09.739287 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:42:09.739287 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:42:09.739287 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:42:09.739287 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:42:09.739287 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:42:09.739287 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:42:09.739287 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:42:09.739287 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:42:09.739287 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:42:09.739287 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:42:09.740185 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:42:09.740185 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:42:09.740185 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:42:09.740185 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:42:09.740185 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:42:09.740185 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:42:09.740185 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:42:09.740185 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:42:09.740185 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:42:09.740185 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:42:09.740185 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 00:42:09.740185 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:42:09.742768 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 92/181] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Sep 18 00:42:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:42:09.743943 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfaf8df-dcd9-415c-9995-f5ccd08776dd None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:09.811971 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcaab58-4ae6-4e4c-88bc-873350fac3ad None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:09.856954 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfaf8df-dcd9-415c-9995-f5ccd08776dd None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:09.883717 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:09.884084 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e398b84-969f-43ae-880b-3142d0f9cc4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:09.886383 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e398b84-969f-43ae-880b-3142d0f9cc4d None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:09.887062 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e398b84-969f-43ae-880b-3142d0f9cc4d None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:09.887754 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e398b84-969f-43ae-880b-3142d0f9cc4d None admin] PATH_INFO: `/v3/projects/71680fa1985e4fc4a5c1a73f87753f66` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:09.890384 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e398b84-969f-43ae-880b-3142d0f9cc4d None admin] RBAC: Authorizing `identity:get_project(project_id=71680fa1985e4fc4a5c1a73f87753f66)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:09.893198 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e398b84-969f-43ae-880b-3142d0f9cc4d None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:09.896570 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 90/182] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Sep 18 00:42:09 2022] GET /identity/v3/projects/71680fa1985e4fc4a5c1a73f87753f66 => generated 298 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:09.898571 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e398b84-969f-43ae-880b-3142d0f9cc4d None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:09.906393 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53bab1f-dcfe-447e-b7c3-179d0c1c6158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:09.907259 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53bab1f-dcfe-447e-b7c3-179d0c1c6158 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:09.907669 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53bab1f-dcfe-447e-b7c3-179d0c1c6158 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:09.908159 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53bab1f-dcfe-447e-b7c3-179d0c1c6158 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:09.909502 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53bab1f-dcfe-447e-b7c3-179d0c1c6158 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:09.911137 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53bab1f-dcfe-447e-b7c3-179d0c1c6158 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:09.914256 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 93/183] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:42:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:09.915210 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53bab1f-dcfe-447e-b7c3-179d0c1c6158 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:10.072283 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:10.075198 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53bab1f-dcfe-447e-b7c3-179d0c1c6158 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:10.091511 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e398b84-969f-43ae-880b-3142d0f9cc4d None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:10.121911 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab86101-c0c0-4d31-9135-42759eaa6c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:10.122892 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab86101-c0c0-4d31-9135-42759eaa6c85 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:10.123244 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab86101-c0c0-4d31-9135-42759eaa6c85 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:10.123557 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab86101-c0c0-4d31-9135-42759eaa6c85 None admin] PATH_INFO: `/v3/roles` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:10.124418 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab86101-c0c0-4d31-9135-42759eaa6c85 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:42:10.124771 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab86101-c0c0-4d31-9135-42759eaa6c85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:10.126365 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab86101-c0c0-4d31-9135-42759eaa6c85 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:10.136629 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 94/184] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Sep 18 00:42:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:10.136962 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2a4362-7ec3-4fba-bcbd-d3e45b16b6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:10.137720 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a4362-7ec3-4fba-bcbd-d3e45b16b6be None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:10.138123 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a4362-7ec3-4fba-bcbd-d3e45b16b6be None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:10.138512 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a4362-7ec3-4fba-bcbd-d3e45b16b6be None admin] PATH_INFO: `/v3/users/1c01447d95d54e7ba8fab62b6917c9ae` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:10.138905 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c46fae-5653-4ec6-af08-9a86d9aa5231 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:10.139395 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c46fae-5653-4ec6-af08-9a86d9aa5231 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:10.139878 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c46fae-5653-4ec6-af08-9a86d9aa5231 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:10.140290 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2a4362-7ec3-4fba-bcbd-d3e45b16b6be None admin] RBAC: Authorizing `identity:get_user(user_id=1c01447d95d54e7ba8fab62b6917c9ae)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:10.141926 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2a4362-7ec3-4fba-bcbd-d3e45b16b6be None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:10.142425 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 95/185] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:42:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:42:10.144549 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c46fae-5653-4ec6-af08-9a86d9aa5231 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:10.149542 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 91/186] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Sep 18 00:42:09 2022] GET /identity/v3/users/1c01447d95d54e7ba8fab62b6917c9ae => generated 275 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:10.150821 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2a4362-7ec3-4fba-bcbd-d3e45b16b6be None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:10.237050 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:10.297429 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2a4362-7ec3-4fba-bcbd-d3e45b16b6be None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:10.310700 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c46fae-5653-4ec6-af08-9a86d9aa5231 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:10.336230 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8f2f9a-eb1d-4200-a776-66b3673b863a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:10.336890 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f2f9a-eb1d-4200-a776-66b3673b863a None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:10.337266 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f2f9a-eb1d-4200-a776-66b3673b863a None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:10.337622 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f2f9a-eb1d-4200-a776-66b3673b863a None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:10.338363 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8f2f9a-eb1d-4200-a776-66b3673b863a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:10.340035 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8f2f9a-eb1d-4200-a776-66b3673b863a None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:10.355570 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607383de-ba1f-421c-9967-8c443e36c576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:10.356377 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607383de-ba1f-421c-9967-8c443e36c576 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:10.356691 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607383de-ba1f-421c-9967-8c443e36c576 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:10.356978 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607383de-ba1f-421c-9967-8c443e36c576 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:10.357786 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607383de-ba1f-421c-9967-8c443e36c576 None admin] RBAC: Adding query filter params (role.id=591d4711dc204cf98003c8b7d7558506, scope.project.id=71680fa1985e4fc4a5c1a73f87753f66, user.id=0f8bf0607941426a8b8271be8b554394) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:42:10.358141 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607383de-ba1f-421c-9967-8c443e36c576 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:10.359709 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607383de-ba1f-421c-9967-8c443e36c576 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:10.380112 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 92/187] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Sep 18 00:42:10 2022] POST /identity/v3/users => generated 297 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 00:42:10.380439 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 96/188] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Sep 18 00:42:10 2022] GET /identity/v3/role_assignments?user.id=0f8bf0607941426a8b8271be8b554394&scope.project.id=71680fa1985e4fc4a5c1a73f87753f66&role.id=591d4711dc204cf98003c8b7d7558506 => generated 608 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:10.380439 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607383de-ba1f-421c-9967-8c443e36c576 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:10.380657 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8f2f9a-eb1d-4200-a776-66b3673b863a None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:10.397363 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:10.558047 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607383de-ba1f-421c-9967-8c443e36c576 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:10.580381 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:10.604497 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485af89-814b-4db1-a584-32118f590fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:10.605251 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485af89-814b-4db1-a584-32118f590fb9 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:10.605772 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485af89-814b-4db1-a584-32118f590fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:10.606248 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485af89-814b-4db1-a584-32118f590fb9 None admin] PATH_INFO: `/v3/users/be1d41cd94ee47eabe65a1747ef1e5b1` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:10.606963 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8f2f9a-eb1d-4200-a776-66b3673b863a None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:10.624924 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8485af89-814b-4db1-a584-32118f590fb9 None admin] RBAC: Authorizing `identity:get_user(user_id=be1d41cd94ee47eabe65a1747ef1e5b1)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:10.626757 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8485af89-814b-4db1-a584-32118f590fb9 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:10.629129 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 97/189] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Sep 18 00:42:10 2022] GET /identity/v3/users/be1d41cd94ee47eabe65a1747ef1e5b1 => generated 283 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:10.631186 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd1e19-5530-4370-92cf-ca44891841ea None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:10.631581 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd1e19-5530-4370-92cf-ca44891841ea None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:10.631988 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd1e19-5530-4370-92cf-ca44891841ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:10.653554 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-01fd1e19-5530-4370-92cf-ca44891841ea None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:42:10.655051 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-01fd1e19-5530-4370-92cf-ca44891841ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:42:10.688043 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c2b3a8-9aa6-4439-8fc3-60be5db4336f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:10.689160 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2b3a8-9aa6-4439-8fc3-60be5db4336f None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:10.689662 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2b3a8-9aa6-4439-8fc3-60be5db4336f None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:10.690154 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2b3a8-9aa6-4439-8fc3-60be5db4336f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:10.723773 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c2b3a8-9aa6-4439-8fc3-60be5db4336f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:42:10.736650 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-b0c2b3a8-9aa6-4439-8fc3-60be5db4336f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 18 00:42:10.736650 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:42:10.736650 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:42:10.736650 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:42:10.736650 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:42:10.736650 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:42:10.736650 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:42:10.736650 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:42:10.736650 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:42:10.736650 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:42:10.736650 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:42:10.736650 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:42:10.736650 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:42:10.736650 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:42:10.736650 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:42:10.736650 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:42:10.738357 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:42:10.738357 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:42:10.738357 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:42:10.738357 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:42:10.738357 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:42:10.738357 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:42:10.738357 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:42:10.738357 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:42:10.738357 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:42:10.738357 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:42:10.738357 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:42:10.738357 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:42:10.738357 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:42:10.738357 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:42:10.738357 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:42:10.738357 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:42:10.740473 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:42:10.740473 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:42:10.740473 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:42:10.740473 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:42:10.740473 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:42:10.740473 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:42:10.740473 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:42:10.740473 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:42:10.740473 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:42:10.740473 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:42:10.740473 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 18 00:42:10.740473 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:42:10.740473 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 93/190] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Sep 18 00:42:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:42:10.740473 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c2b3a8-9aa6-4439-8fc3-60be5db4336f None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:10.770397 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 98/191] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:42:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 00:42:10.771442 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fd1e19-5530-4370-92cf-ca44891841ea None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:10.884255 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:10.940238 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c2b3a8-9aa6-4439-8fc3-60be5db4336f None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:10.944456 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fd1e19-5530-4370-92cf-ca44891841ea None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:10.955348 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:11.024398 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c9605f-c0e8-4c44-ab24-5b93d31e4ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:11.025530 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9605f-c0e8-4c44-ab24-5b93d31e4ead None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:11.026163 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9605f-c0e8-4c44-ab24-5b93d31e4ead None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:11.026651 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9605f-c0e8-4c44-ab24-5b93d31e4ead None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:11.029717 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe9eeb-4fd9-4d64-bd2d-c2286cc54a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:11.031145 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe9eeb-4fd9-4d64-bd2d-c2286cc54a6a None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:11.032425 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe9eeb-4fd9-4d64-bd2d-c2286cc54a6a None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:11.034572 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe9eeb-4fd9-4d64-bd2d-c2286cc54a6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:11.162159 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fe9eeb-4fd9-4d64-bd2d-c2286cc54a6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:11.163660 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fe9eeb-4fd9-4d64-bd2d-c2286cc54a6a None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:11.180377 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c9605f-c0e8-4c44-ab24-5b93d31e4ead None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:11.181920 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c9605f-c0e8-4c44-ab24-5b93d31e4ead None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:11.348807 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:11.388136 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 99/192] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Sep 18 00:42:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 617 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 00:42:11.389640 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe9eeb-4fd9-4d64-bd2d-c2286cc54a6a None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:11.395407 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:11.417983 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 94/193] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Sep 18 00:42:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 679 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 00:42:11.425620 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c9605f-c0e8-4c44-ab24-5b93d31e4ead None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:11.596000 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe9eeb-4fd9-4d64-bd2d-c2286cc54a6a None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:11.627040 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c9605f-c0e8-4c44-ab24-5b93d31e4ead None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:11.657606 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da162620-01ad-4b8b-87f8-b0b36ec777c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:11.659626 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da162620-01ad-4b8b-87f8-b0b36ec777c9 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:11.660377 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da162620-01ad-4b8b-87f8-b0b36ec777c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:11.661055 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da162620-01ad-4b8b-87f8-b0b36ec777c9 None admin] PATH_INFO: `/v3/roles` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:11.662534 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da162620-01ad-4b8b-87f8-b0b36ec777c9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:42:11.663295 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da162620-01ad-4b8b-87f8-b0b36ec777c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:11.666274 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da162620-01ad-4b8b-87f8-b0b36ec777c9 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:11.683762 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 100/194] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Sep 18 00:42:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:11.685730 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da162620-01ad-4b8b-87f8-b0b36ec777c9 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:11.691774 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd584f-d187-41e0-ba74-d08b6aac6da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:11.692463 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd584f-d187-41e0-ba74-d08b6aac6da8 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:11.692848 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd584f-d187-41e0-ba74-d08b6aac6da8 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:11.694428 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd584f-d187-41e0-ba74-d08b6aac6da8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:11.705743 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fd584f-d187-41e0-ba74-d08b6aac6da8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:42:11.711406 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-79fd584f-d187-41e0-ba74-d08b6aac6da8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 18 00:42:11.711406 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:42:11.711406 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:42:11.711406 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:42:11.711406 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:42:11.711406 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:42:11.711406 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:42:11.711406 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:42:11.711406 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:42:11.711406 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:42:11.711406 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:42:11.711406 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:42:11.711406 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:42:11.711406 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:42:11.711406 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:42:11.711406 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:42:11.713447 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:42:11.713447 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:42:11.713447 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:42:11.713447 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:42:11.713447 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:42:11.713447 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:42:11.713447 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:42:11.713447 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:42:11.713447 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:42:11.713447 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:42:11.713447 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:42:11.713447 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:42:11.713447 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:42:11.713447 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:42:11.713447 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:42:11.713447 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:42:11.715282 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:42:11.715282 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:42:11.715282 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:42:11.715282 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:42:11.715282 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:42:11.715282 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:42:11.715282 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:42:11.715282 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:42:11.715282 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:42:11.715282 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:42:11.715282 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 18 00:42:11.715282 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:42:11.715282 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 95/195] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Sep 18 00:42:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:42:11.715282 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd584f-d187-41e0-ba74-d08b6aac6da8 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:11.761984 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:11.810437 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:11.880465 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da162620-01ad-4b8b-87f8-b0b36ec777c9 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:11.890831 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd584f-d187-41e0-ba74-d08b6aac6da8 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:11.950638 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef158eb-e7d0-405b-8900-8b58bc5add69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:11.951600 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef158eb-e7d0-405b-8900-8b58bc5add69 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:11.952143 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef158eb-e7d0-405b-8900-8b58bc5add69 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:11.952622 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef158eb-e7d0-405b-8900-8b58bc5add69 None admin] PATH_INFO: `/v3/projects/14cc5534b3054dfbbc19e546f4d51538` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:11.954384 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0009a4-b1b5-476f-9b72-ec7bd8e08e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:11.954696 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef158eb-e7d0-405b-8900-8b58bc5add69 None admin] RBAC: Authorizing `identity:get_project(project_id=14cc5534b3054dfbbc19e546f4d51538)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:11.955480 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0009a4-b1b5-476f-9b72-ec7bd8e08e3d None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:11.955987 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0009a4-b1b5-476f-9b72-ec7bd8e08e3d None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:11.956480 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0009a4-b1b5-476f-9b72-ec7bd8e08e3d None admin] PATH_INFO: `/v3/projects/dfe5fc7a6d694e58898af7d697d5eb2b` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:11.957402 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef158eb-e7d0-405b-8900-8b58bc5add69 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:11.958349 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0009a4-b1b5-476f-9b72-ec7bd8e08e3d None admin] RBAC: Authorizing `identity:get_project(project_id=dfe5fc7a6d694e58898af7d697d5eb2b)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:11.960068 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0009a4-b1b5-476f-9b72-ec7bd8e08e3d None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:11.961966 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 96/196] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Sep 18 00:42:11 2022] GET /identity/v3/projects/dfe5fc7a6d694e58898af7d697d5eb2b => generated 312 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:11.963067 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0009a4-b1b5-476f-9b72-ec7bd8e08e3d None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:11.965537 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 101/197] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Sep 18 00:42:11 2022] GET /identity/v3/projects/14cc5534b3054dfbbc19e546f4d51538 => generated 302 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:11.970163 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef158eb-e7d0-405b-8900-8b58bc5add69 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:12.124545 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:12.129573 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0009a4-b1b5-476f-9b72-ec7bd8e08e3d None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:12.145113 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef158eb-e7d0-405b-8900-8b58bc5add69 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:12.172597 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0371eb-20c3-41ea-8e45-b12182371514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:12.173363 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0371eb-20c3-41ea-8e45-b12182371514 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:12.173735 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0371eb-20c3-41ea-8e45-b12182371514 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:12.174100 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0371eb-20c3-41ea-8e45-b12182371514 None admin] PATH_INFO: `/v3/users/be1d41cd94ee47eabe65a1747ef1e5b1` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:12.175389 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0371eb-20c3-41ea-8e45-b12182371514 None admin] RBAC: Authorizing `identity:get_user(user_id=be1d41cd94ee47eabe65a1747ef1e5b1)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:12.176986 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0371eb-20c3-41ea-8e45-b12182371514 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:12.183663 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 97/198] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Sep 18 00:42:11 2022] GET /identity/v3/users/be1d41cd94ee47eabe65a1747ef1e5b1 => generated 283 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:12.184768 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0371eb-20c3-41ea-8e45-b12182371514 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:12.188324 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5feaed2-72c8-4414-bf41-b45bd6eb26f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:12.190082 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5feaed2-72c8-4414-bf41-b45bd6eb26f5 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:12.190515 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5feaed2-72c8-4414-bf41-b45bd6eb26f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:12.190936 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5feaed2-72c8-4414-bf41-b45bd6eb26f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:12.191763 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5feaed2-72c8-4414-bf41-b45bd6eb26f5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:42:12.192242 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5feaed2-72c8-4414-bf41-b45bd6eb26f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:12.194365 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5feaed2-72c8-4414-bf41-b45bd6eb26f5 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:12.196743 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:12.207439 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 102/199] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Sep 18 00:42:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:12.208612 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5feaed2-72c8-4414-bf41-b45bd6eb26f5 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:12.327657 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5feaed2-72c8-4414-bf41-b45bd6eb26f5 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:12.331874 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0371eb-20c3-41ea-8e45-b12182371514 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:12.366245 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143369da-f894-4150-973d-5703891ee302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:12.367109 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143369da-f894-4150-973d-5703891ee302 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:12.367541 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143369da-f894-4150-973d-5703891ee302 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:12.367998 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143369da-f894-4150-973d-5703891ee302 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:12.368889 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143369da-f894-4150-973d-5703891ee302 None admin] RBAC: Adding query filter params (role.id=59d7218a321b4c20bc1996494a48a2a1, scope.project.id=dfe5fc7a6d694e58898af7d697d5eb2b, user.id=1c01447d95d54e7ba8fab62b6917c9ae) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:42:12.369380 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143369da-f894-4150-973d-5703891ee302 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:12.371030 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143369da-f894-4150-973d-5703891ee302 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:12.376970 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b58ee-f879-4b5b-8ab1-78b2ea5b6d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:12.377674 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b58ee-f879-4b5b-8ab1-78b2ea5b6d30 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:12.378017 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b58ee-f879-4b5b-8ab1-78b2ea5b6d30 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:12.378357 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b58ee-f879-4b5b-8ab1-78b2ea5b6d30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:12.379190 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 103/200] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Sep 18 00:42:12 2022] GET /identity/v3/role_assignments?user.id=1c01447d95d54e7ba8fab62b6917c9ae&scope.project.id=dfe5fc7a6d694e58898af7d697d5eb2b&role.id=59d7218a321b4c20bc1996494a48a2a1 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:12.379558 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441b58ee-f879-4b5b-8ab1-78b2ea5b6d30 None admin] RBAC: Adding query filter params (role.id=591d4711dc204cf98003c8b7d7558506, scope.project.id=14cc5534b3054dfbbc19e546f4d51538, user.id=be1d41cd94ee47eabe65a1747ef1e5b1) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:42:12.379946 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441b58ee-f879-4b5b-8ab1-78b2ea5b6d30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:12.380829 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143369da-f894-4150-973d-5703891ee302 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:12.381623 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441b58ee-f879-4b5b-8ab1-78b2ea5b6d30 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:12.388778 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 98/201] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Sep 18 00:42:12 2022] GET /identity/v3/role_assignments?user.id=be1d41cd94ee47eabe65a1747ef1e5b1&scope.project.id=14cc5534b3054dfbbc19e546f4d51538&role.id=591d4711dc204cf98003c8b7d7558506 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:12.395528 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b58ee-f879-4b5b-8ab1-78b2ea5b6d30 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:12.482672 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:12.487237 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:12.564556 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143369da-f894-4150-973d-5703891ee302 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:12.623565 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8448c-f567-491a-99c4-639022cb2f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:12.624256 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8448c-f567-491a-99c4-639022cb2f60 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:12.624540 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8448c-f567-491a-99c4-639022cb2f60 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:12.624814 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8448c-f567-491a-99c4-639022cb2f60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:12.686653 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b58ee-f879-4b5b-8ab1-78b2ea5b6d30 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:12.703489 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb8448c-f567-491a-99c4-639022cb2f60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:12.705049 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb8448c-f567-491a-99c4-639022cb2f60 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:12.757530 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03944cb-22d2-4728-825c-fefe67e997ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:12.758115 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03944cb-22d2-4728-825c-fefe67e997ac None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:12.758404 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03944cb-22d2-4728-825c-fefe67e997ac None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:12.758677 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03944cb-22d2-4728-825c-fefe67e997ac None admin] PATH_INFO: `/v3/users/4960cbbfbe784c4086adb3376322e064` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:12.764956 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03944cb-22d2-4728-825c-fefe67e997ac None admin] RBAC: Authorizing `identity:get_user(user_id=4960cbbfbe784c4086adb3376322e064)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:12.766788 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03944cb-22d2-4728-825c-fefe67e997ac None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:12.768918 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 99/202] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Sep 18 00:42:12 2022] GET /identity/v3/users/4960cbbfbe784c4086adb3376322e064 => generated 289 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:12.775224 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03944cb-22d2-4728-825c-fefe67e997ac None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:12.781982 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:12.835921 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 104/203] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Sep 18 00:42:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 00:42:12.846227 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8448c-f567-491a-99c4-639022cb2f60 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:12.978845 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8448c-f567-491a-99c4-639022cb2f60 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:13.010647 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:13.015590 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03944cb-22d2-4728-825c-fefe67e997ac None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:13.023678 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b0c0e0-88a8-4b2c-b5fa-a82e8f07fe36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:13.026404 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0c0e0-88a8-4b2c-b5fa-a82e8f07fe36 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:13.026691 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0c0e0-88a8-4b2c-b5fa-a82e8f07fe36 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:13.026973 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0c0e0-88a8-4b2c-b5fa-a82e8f07fe36 None admin] PATH_INFO: `/v3/projects/14cc5534b3054dfbbc19e546f4d51538` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:13.028466 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b0c0e0-88a8-4b2c-b5fa-a82e8f07fe36 None admin] RBAC: Authorizing `identity:get_project(project_id=14cc5534b3054dfbbc19e546f4d51538)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:13.029979 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b0c0e0-88a8-4b2c-b5fa-a82e8f07fe36 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:13.031860 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 105/204] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Sep 18 00:42:12 2022] GET /identity/v3/projects/14cc5534b3054dfbbc19e546f4d51538 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:13.041452 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b0c0e0-88a8-4b2c-b5fa-a82e8f07fe36 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:13.072080 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f087f-35a2-41a0-a613-e5ae9cad4d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:13.072765 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f087f-35a2-41a0-a613-e5ae9cad4d2c None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:13.073048 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f087f-35a2-41a0-a613-e5ae9cad4d2c None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:13.073388 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f087f-35a2-41a0-a613-e5ae9cad4d2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:13.125175 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:13.164392 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2f087f-35a2-41a0-a613-e5ae9cad4d2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:13.165915 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2f087f-35a2-41a0-a613-e5ae9cad4d2c None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:13.309197 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b0c0e0-88a8-4b2c-b5fa-a82e8f07fe36 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:13.316339 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:13.326137 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 100/205] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Sep 18 00:42:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 00:42:13.349392 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f087f-35a2-41a0-a613-e5ae9cad4d2c None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:13.389317 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd5b63-d302-4a2f-ba42-fffd508b7efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:13.389956 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd5b63-d302-4a2f-ba42-fffd508b7efd None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:13.390245 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd5b63-d302-4a2f-ba42-fffd508b7efd None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:13.390520 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd5b63-d302-4a2f-ba42-fffd508b7efd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:13.391275 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fd5b63-d302-4a2f-ba42-fffd508b7efd None admin] RBAC: Adding query filter params (role.id=e2a7bd363c424c5380514254ad1cc522, scope.project.id=14cc5534b3054dfbbc19e546f4d51538, user.id=be1d41cd94ee47eabe65a1747ef1e5b1) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:42:13.391589 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fd5b63-d302-4a2f-ba42-fffd508b7efd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:13.393100 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fd5b63-d302-4a2f-ba42-fffd508b7efd None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:13.406901 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 106/206] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Sep 18 00:42:13 2022] GET /identity/v3/role_assignments?user.id=be1d41cd94ee47eabe65a1747ef1e5b1&scope.project.id=14cc5534b3054dfbbc19e546f4d51538&role.id=e2a7bd363c424c5380514254ad1cc522 => generated 259 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:42:13.433879 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459c876-2be1-4e25-bca4-dac231d61ada None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:13.434546 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459c876-2be1-4e25-bca4-dac231d61ada None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:13.435027 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459c876-2be1-4e25-bca4-dac231d61ada None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:13.437024 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 107/207] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:42:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:42:13.443454 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8415958-f08a-4337-aa8b-fb010c2894d9 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:13.444575 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8415958-f08a-4337-aa8b-fb010c2894d9 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:13.445072 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8415958-f08a-4337-aa8b-fb010c2894d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:13.482634 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-a8415958-f08a-4337-aa8b-fb010c2894d9 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:42:13.485609 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-a8415958-f08a-4337-aa8b-fb010c2894d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:42:13.532363 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f087f-35a2-41a0-a613-e5ae9cad4d2c None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:13.583256 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa3abad-d6e1-4de6-bf2c-20fc31de6ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:13.584395 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3abad-d6e1-4de6-bf2c-20fc31de6ed2 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:13.584911 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3abad-d6e1-4de6-bf2c-20fc31de6ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:13.585395 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3abad-d6e1-4de6-bf2c-20fc31de6ed2 None admin] PATH_INFO: `/v3/projects/71680fa1985e4fc4a5c1a73f87753f66` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:13.586895 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa3abad-d6e1-4de6-bf2c-20fc31de6ed2 None admin] RBAC: Authorizing `identity:get_project(project_id=71680fa1985e4fc4a5c1a73f87753f66)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:13.588710 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa3abad-d6e1-4de6-bf2c-20fc31de6ed2 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:13.590677 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 101/208] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Sep 18 00:42:13 2022] GET /identity/v3/projects/71680fa1985e4fc4a5c1a73f87753f66 => generated 298 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:42:13.601015 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa3abad-d6e1-4de6-bf2c-20fc31de6ed2 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:13.683933 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 108/209] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:42:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 18 00:42:13.685682 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb2905-8ee5-4987-bf91-d1cdc6f44f86 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:13.686241 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb2905-8ee5-4987-bf91-d1cdc6f44f86 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:13.686753 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb2905-8ee5-4987-bf91-d1cdc6f44f86 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:13.688443 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 109/210] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:42:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:42:13.698008 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e6b44-f70a-4f95-b6b2-7ac4e7ee38ac None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:13.698907 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e6b44-f70a-4f95-b6b2-7ac4e7ee38ac None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:13.699635 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e6b44-f70a-4f95-b6b2-7ac4e7ee38ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:13.743387 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-0f9e6b44-f70a-4f95-b6b2-7ac4e7ee38ac None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:42:13.746904 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-0f9e6b44-f70a-4f95-b6b2-7ac4e7ee38ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:42:13.758513 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:13.799968 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:13.806286 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa3abad-d6e1-4de6-bf2c-20fc31de6ed2 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:13.848325 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793fc8ad-262c-485d-b17d-031dcb7bb8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:13.848853 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793fc8ad-262c-485d-b17d-031dcb7bb8c3 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:13.849187 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793fc8ad-262c-485d-b17d-031dcb7bb8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:13.849464 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793fc8ad-262c-485d-b17d-031dcb7bb8c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:13.850219 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793fc8ad-262c-485d-b17d-031dcb7bb8c3 None admin] RBAC: Adding query filter params (role.id=21a002d535ce432597d9291135265677, scope.project.id=71680fa1985e4fc4a5c1a73f87753f66, user.id=4960cbbfbe784c4086adb3376322e064) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:42:13.850527 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793fc8ad-262c-485d-b17d-031dcb7bb8c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:13.852950 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793fc8ad-262c-485d-b17d-031dcb7bb8c3 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:13.861644 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 102/211] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Sep 18 00:42:13 2022] GET /identity/v3/role_assignments?user.id=4960cbbfbe784c4086adb3376322e064&scope.project.id=71680fa1985e4fc4a5c1a73f87753f66&role.id=21a002d535ce432597d9291135265677 => generated 608 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:13.978573 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793fc8ad-262c-485d-b17d-031dcb7bb8c3 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:13.990769 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 110/212] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:42:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 18 00:42:14.184464 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793fc8ad-262c-485d-b17d-031dcb7bb8c3 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:14.221984 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:14.228165 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e0337d-6df7-4164-87fe-fff62f851e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:14.229522 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0337d-6df7-4164-87fe-fff62f851e74 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:14.229811 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0337d-6df7-4164-87fe-fff62f851e74 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:14.230096 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0337d-6df7-4164-87fe-fff62f851e74 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:14.231468 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e0337d-6df7-4164-87fe-fff62f851e74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:14.233668 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e0337d-6df7-4164-87fe-fff62f851e74 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:14.236470 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 103/213] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:42:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:42:14.248266 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e6b44-f70a-4f95-b6b2-7ac4e7ee38ac None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:14.451045 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e6b44-f70a-4f95-b6b2-7ac4e7ee38ac None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:14.503331 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e0337d-6df7-4164-87fe-fff62f851e74 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:14.540084 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51ea2aa-e21f-4ec9-abf0-60a448c36e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:14.541168 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ea2aa-e21f-4ec9-abf0-60a448c36e96 None admin] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:14.541918 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ea2aa-e21f-4ec9-abf0-60a448c36e96 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:14.542370 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ea2aa-e21f-4ec9-abf0-60a448c36e96 None admin] PATH_INFO: `/v3/users` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:14.543620 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51ea2aa-e21f-4ec9-abf0-60a448c36e96 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:14.549890 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51ea2aa-e21f-4ec9-abf0-60a448c36e96 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:14.591357 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 111/214] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Sep 18 00:42:14 2022] POST /identity/v3/users => generated 297 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 00:42:14.681042 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e0337d-6df7-4164-87fe-fff62f851e74 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:14.723948 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7afa7b-e1ff-4b01-8968-2b44816b1afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:14.724579 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7afa7b-e1ff-4b01-8968-2b44816b1afb None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:14.724859 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7afa7b-e1ff-4b01-8968-2b44816b1afb None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:14.725131 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7afa7b-e1ff-4b01-8968-2b44816b1afb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:14.738167 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7afa7b-e1ff-4b01-8968-2b44816b1afb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:42:14.745215 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-fc7afa7b-e1ff-4b01-8968-2b44816b1afb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 18 00:42:14.745215 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:42:14.745215 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:42:14.745215 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:42:14.745215 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:42:14.745215 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:42:14.745215 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:42:14.745215 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:42:14.745215 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:42:14.745215 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:42:14.745215 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:42:14.745215 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:42:14.745215 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:42:14.745215 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:42:14.745215 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:42:14.745215 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:42:14.746192 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:42:14.746192 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:42:14.746192 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:42:14.746192 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:42:14.746192 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:42:14.746192 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:42:14.746192 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:42:14.746192 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:42:14.746192 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:42:14.746192 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:42:14.746192 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:42:14.746192 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:42:14.746192 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:42:14.746192 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:42:14.746192 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:42:14.746192 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:42:14.746985 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:42:14.746985 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:42:14.746985 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:42:14.746985 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:42:14.746985 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:42:14.746985 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:42:14.746985 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:42:14.746985 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:42:14.746985 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:42:14.746985 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:42:14.746985 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 18 00:42:14.746985 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:42:14.746985 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 104/215] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Sep 18 00:42:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:42:14.755344 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51ea2aa-e21f-4ec9-abf0-60a448c36e96 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:14.769165 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:14.898842 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51ea2aa-e21f-4ec9-abf0-60a448c36e96 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:14.939718 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ef9dc-1259-4fd2-83e2-122042fdb995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:14.940387 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ef9dc-1259-4fd2-83e2-122042fdb995 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:14.940665 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ef9dc-1259-4fd2-83e2-122042fdb995 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:14.940936 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ef9dc-1259-4fd2-83e2-122042fdb995 None admin] PATH_INFO: `/v3/roles` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:14.941620 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948ef9dc-1259-4fd2-83e2-122042fdb995 None admin] RBAC: Adding query filter params (name=member) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:42:14.941921 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948ef9dc-1259-4fd2-83e2-122042fdb995 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:14.944074 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948ef9dc-1259-4fd2-83e2-122042fdb995 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:14.953568 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 112/216] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Sep 18 00:42:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:42:14.959630 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7afa7b-e1ff-4b01-8968-2b44816b1afb None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:15.039099 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:15.100820 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7afa7b-e1ff-4b01-8968-2b44816b1afb None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:15.148963 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d57de0-e233-4650-b132-a8982f97c9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:15.149690 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d57de0-e233-4650-b132-a8982f97c9d4 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:15.149972 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d57de0-e233-4650-b132-a8982f97c9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:15.150263 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d57de0-e233-4650-b132-a8982f97c9d4 None admin] PATH_INFO: `/v3/users/3f62ac376ca84b38b71691623699f6d8` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:15.168922 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d57de0-e233-4650-b132-a8982f97c9d4 None admin] RBAC: Authorizing `identity:get_user(user_id=3f62ac376ca84b38b71691623699f6d8)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:15.170555 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d57de0-e233-4650-b132-a8982f97c9d4 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:15.173142 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 105/217] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Sep 18 00:42:14 2022] GET /identity/v3/users/3f62ac376ca84b38b71691623699f6d8 => generated 297 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:42:15.178433 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ef9dc-1259-4fd2-83e2-122042fdb995 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:15.335821 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:15.423155 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ef9dc-1259-4fd2-83e2-122042fdb995 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:15.506694 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc37aa5-cdca-44e4-90ca-185978bdb851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:15.507690 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc37aa5-cdca-44e4-90ca-185978bdb851 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:15.508220 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc37aa5-cdca-44e4-90ca-185978bdb851 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:15.508717 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc37aa5-cdca-44e4-90ca-185978bdb851 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:15.673795 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc37aa5-cdca-44e4-90ca-185978bdb851 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:15.676660 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc37aa5-cdca-44e4-90ca-185978bdb851 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:15.842111 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:15.906532 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 113/218] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Sep 18 00:42:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 729 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 18 00:42:15.913332 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d57de0-e233-4650-b132-a8982f97c9d4 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:16.103628 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d57de0-e233-4650-b132-a8982f97c9d4 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:16.131701 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:16.159251 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999710e8-d41f-4c81-acf3-83177c0662eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:16.159951 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999710e8-d41f-4c81-acf3-83177c0662eb None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:16.160235 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999710e8-d41f-4c81-acf3-83177c0662eb None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:16.160525 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999710e8-d41f-4c81-acf3-83177c0662eb None admin] PATH_INFO: `/v3/projects/14cc5534b3054dfbbc19e546f4d51538` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:16.161407 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddec227-e58f-455a-9975-d1d93c72d643 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:16.161866 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddec227-e58f-455a-9975-d1d93c72d643 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:16.162017 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999710e8-d41f-4c81-acf3-83177c0662eb None admin] RBAC: Authorizing `identity:get_project(project_id=14cc5534b3054dfbbc19e546f4d51538)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:16.162356 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddec227-e58f-455a-9975-d1d93c72d643 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:16.163434 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999710e8-d41f-4c81-acf3-83177c0662eb None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:16.165132 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 114/219] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:42:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:42:16.165320 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 106/220] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Sep 18 00:42:15 2022] GET /identity/v3/projects/14cc5534b3054dfbbc19e546f4d51538 => generated 302 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:16.172555 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddec227-e58f-455a-9975-d1d93c72d643 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:16.178897 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d2c26-29f1-4472-8d90-3b34c952dda0 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:16.179187 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d2c26-29f1-4472-8d90-3b34c952dda0 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:16.179515 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d2c26-29f1-4472-8d90-3b34c952dda0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:16.221076 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-623d2c26-29f1-4472-8d90-3b34c952dda0 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:42:16.225409 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-623d2c26-29f1-4472-8d90-3b34c952dda0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:42:16.363822 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 107/221] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:42:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 00:42:16.388672 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddec227-e58f-455a-9975-d1d93c72d643 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:16.454294 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653b7417-8613-494b-b0bb-c506664a52e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:16.454935 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b7417-8613-494b-b0bb-c506664a52e7 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:16.455220 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b7417-8613-494b-b0bb-c506664a52e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:16.455501 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b7417-8613-494b-b0bb-c506664a52e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:16.456280 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653b7417-8613-494b-b0bb-c506664a52e7 None admin] RBAC: Adding query filter params (role.id=59d7218a321b4c20bc1996494a48a2a1, scope.project.id=14cc5534b3054dfbbc19e546f4d51538, user.id=3f62ac376ca84b38b71691623699f6d8) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:42:16.456596 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653b7417-8613-494b-b0bb-c506664a52e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:16.458250 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653b7417-8613-494b-b0bb-c506664a52e7 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:16.476377 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 115/222] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Sep 18 00:42:16 2022] GET /identity/v3/role_assignments?user.id=3f62ac376ca84b38b71691623699f6d8&scope.project.id=14cc5534b3054dfbbc19e546f4d51538&role.id=59d7218a321b4c20bc1996494a48a2a1 => generated 259 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:16.771807 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d2c26-29f1-4472-8d90-3b34c952dda0 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:16.917245 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d2c26-29f1-4472-8d90-3b34c952dda0 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:16.941643 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:16.979541 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e7c71-3c7c-4d43-91e1-4fb75d0f50f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:16.980250 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e7c71-3c7c-4d43-91e1-4fb75d0f50f8 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:16.980570 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e7c71-3c7c-4d43-91e1-4fb75d0f50f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:16.980864 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e7c71-3c7c-4d43-91e1-4fb75d0f50f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:17.000926 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3e7c71-3c7c-4d43-91e1-4fb75d0f50f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:42:17.006249 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-fb3e7c71-3c7c-4d43-91e1-4fb75d0f50f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 00:42:17.006249 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:42:17.006249 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:42:17.006249 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:42:17.006249 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:42:17.006249 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:42:17.006249 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:42:17.006249 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:42:17.006249 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:42:17.006249 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:42:17.006249 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:42:17.006249 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:42:17.006249 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:42:17.006249 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:42:17.006249 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:42:17.006249 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:42:17.007922 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:42:17.007922 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:42:17.007922 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:42:17.007922 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:42:17.007922 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:42:17.007922 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:42:17.007922 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:42:17.007922 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:42:17.007922 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:42:17.007922 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:42:17.007922 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:42:17.007922 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:42:17.007922 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:42:17.007922 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:42:17.007922 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:42:17.007922 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:42:17.009529 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:42:17.009529 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:42:17.009529 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:42:17.009529 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:42:17.009529 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:42:17.009529 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:42:17.009529 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:42:17.009529 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:42:17.009529 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:42:17.009529 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:42:17.009529 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 00:42:17.009529 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:42:17.009529 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 108/223] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Sep 18 00:42:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:42:17.021974 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653b7417-8613-494b-b0bb-c506664a52e7 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:17.074354 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:17.188242 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653b7417-8613-494b-b0bb-c506664a52e7 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:17.236424 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c60cb-8e41-42cf-8015-c95643c927d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:17.237112 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c60cb-8e41-42cf-8015-c95643c927d3 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:17.237388 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c60cb-8e41-42cf-8015-c95643c927d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:17.237661 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c60cb-8e41-42cf-8015-c95643c927d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:17.238345 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05c60cb-8e41-42cf-8015-c95643c927d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:42:17.238654 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05c60cb-8e41-42cf-8015-c95643c927d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:17.240175 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05c60cb-8e41-42cf-8015-c95643c927d3 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:17.255645 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 116/224] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Sep 18 00:42:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:17.265034 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e7c71-3c7c-4d43-91e1-4fb75d0f50f8 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:17.308963 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4985e9-6e23-4f79-902c-a238a37775e9 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:17.309341 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4985e9-6e23-4f79-902c-a238a37775e9 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:17.309578 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4985e9-6e23-4f79-902c-a238a37775e9 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:17.310763 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 117/225] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:42:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 18 00:42:17.319726 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ee5f2-6dc9-488a-a4a6-5f670d0ef76e None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:17.320135 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ee5f2-6dc9-488a-a4a6-5f670d0ef76e None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:17.320363 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ee5f2-6dc9-488a-a4a6-5f670d0ef76e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:17.346891 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-320ee5f2-6dc9-488a-a4a6-5f670d0ef76e None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:42:17.351175 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-320ee5f2-6dc9-488a-a4a6-5f670d0ef76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:42:17.476872 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 118/226] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:42:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 18 00:42:17.511932 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e7c71-3c7c-4d43-91e1-4fb75d0f50f8 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:17.591505 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846d4f9-239b-4599-80fd-f9c34a53a04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:17.592091 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846d4f9-239b-4599-80fd-f9c34a53a04a None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:17.592379 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846d4f9-239b-4599-80fd-f9c34a53a04a None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:17.592656 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846d4f9-239b-4599-80fd-f9c34a53a04a None admin] PATH_INFO: `/v3/users/be1d41cd94ee47eabe65a1747ef1e5b1` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:17.593817 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846d4f9-239b-4599-80fd-f9c34a53a04a None admin] RBAC: Authorizing `identity:get_user(user_id=be1d41cd94ee47eabe65a1747ef1e5b1)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:17.595499 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846d4f9-239b-4599-80fd-f9c34a53a04a None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:17.597504 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 109/227] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Sep 18 00:42:17 2022] GET /identity/v3/users/be1d41cd94ee47eabe65a1747ef1e5b1 => generated 283 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:17.605762 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320ee5f2-6dc9-488a-a4a6-5f670d0ef76e None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:17.651615 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:17.770438 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320ee5f2-6dc9-488a-a4a6-5f670d0ef76e None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:17.824959 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9783e-b74c-4452-9897-ad6564606433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:17.826463 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9783e-b74c-4452-9897-ad6564606433 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:17.827253 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9783e-b74c-4452-9897-ad6564606433 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:17.828060 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9783e-b74c-4452-9897-ad6564606433 None admin] PATH_INFO: `/v3/projects/14cc5534b3054dfbbc19e546f4d51538` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:17.832661 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc9783e-b74c-4452-9897-ad6564606433 None admin] RBAC: Authorizing `identity:get_project(project_id=14cc5534b3054dfbbc19e546f4d51538)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:17.834700 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc9783e-b74c-4452-9897-ad6564606433 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:17.836484 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 119/228] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Sep 18 00:42:17 2022] GET /identity/v3/projects/14cc5534b3054dfbbc19e546f4d51538 => generated 302 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:17.845259 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846d4f9-239b-4599-80fd-f9c34a53a04a None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:17.854036 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9783e-b74c-4452-9897-ad6564606433 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:17.926850 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:17.968324 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:17.977112 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9783e-b74c-4452-9897-ad6564606433 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:18.017068 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44b52c-d20b-4bd9-8233-9ca18e6bc8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:18.017854 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44b52c-d20b-4bd9-8233-9ca18e6bc8c6 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:18.018191 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44b52c-d20b-4bd9-8233-9ca18e6bc8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:18.018473 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44b52c-d20b-4bd9-8233-9ca18e6bc8c6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:18.030760 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de44b52c-d20b-4bd9-8233-9ca18e6bc8c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:42:18.036151 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-de44b52c-d20b-4bd9-8233-9ca18e6bc8c6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 18 00:42:18.036151 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:42:18.036151 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:42:18.036151 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:42:18.036151 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:42:18.036151 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:42:18.036151 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:42:18.036151 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:42:18.036151 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:42:18.036151 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:42:18.036151 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:42:18.036151 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:42:18.036151 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:42:18.036151 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:42:18.036151 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:42:18.036151 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:42:18.038105 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:42:18.038105 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:42:18.038105 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:42:18.038105 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:42:18.038105 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:42:18.038105 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:42:18.038105 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:42:18.038105 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:42:18.038105 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:42:18.038105 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:42:18.038105 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:42:18.038105 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:42:18.038105 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:42:18.038105 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:42:18.038105 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:42:18.038105 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:42:18.039669 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:42:18.039669 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:42:18.039669 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:42:18.039669 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:42:18.039669 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:42:18.039669 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:42:18.039669 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:42:18.039669 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:42:18.039669 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:42:18.039669 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:42:18.039669 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 18 00:42:18.039669 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:42:18.039669 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 120/229] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Sep 18 00:42:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 00:42:18.047119 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44b52c-d20b-4bd9-8233-9ca18e6bc8c6 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:18.054513 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846d4f9-239b-4599-80fd-f9c34a53a04a None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:18.161072 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a148d89-1105-40c3-9b13-eda9034945e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:18.162753 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a148d89-1105-40c3-9b13-eda9034945e8 None admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:18.163217 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a148d89-1105-40c3-9b13-eda9034945e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:18.163700 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a148d89-1105-40c3-9b13-eda9034945e8 None admin] PATH_INFO: `/v3/projects/14cc5534b3054dfbbc19e546f4d51538/users/be1d41cd94ee47eabe65a1747ef1e5b1/roles/591d4711dc204cf98003c8b7d7558506` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:18.167928 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44b52c-d20b-4bd9-8233-9ca18e6bc8c6 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:18.170709 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a148d89-1105-40c3-9b13-eda9034945e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=14cc5534b3054dfbbc19e546f4d51538, user_id=be1d41cd94ee47eabe65a1747ef1e5b1, role_id=591d4711dc204cf98003c8b7d7558506)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:18.173346 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a148d89-1105-40c3-9b13-eda9034945e8 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:18.202096 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 110/230] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Sep 18 00:42:17 2022] PUT /identity/v3/projects/14cc5534b3054dfbbc19e546f4d51538/users/be1d41cd94ee47eabe65a1747ef1e5b1/roles/591d4711dc204cf98003c8b7d7558506 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 00:42:18.226879 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7cfa32-5a93-4d89-a855-0f71cdf231ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:18.227566 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7cfa32-5a93-4d89-a855-0f71cdf231ee None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:18.227842 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7cfa32-5a93-4d89-a855-0f71cdf231ee None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:18.228204 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7cfa32-5a93-4d89-a855-0f71cdf231ee None admin] PATH_INFO: `/v3/roles` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:18.228973 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7cfa32-5a93-4d89-a855-0f71cdf231ee None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:42:18.229287 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7cfa32-5a93-4d89-a855-0f71cdf231ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:18.230826 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7cfa32-5a93-4d89-a855-0f71cdf231ee None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:18.246178 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 121/231] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Sep 18 00:42:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:18.248016 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a148d89-1105-40c3-9b13-eda9034945e8 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:18.409845 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a148d89-1105-40c3-9b13-eda9034945e8 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:18.417772 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:18.466904 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4e016f-5714-4374-b86f-c4960f8f1463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:18.467572 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e016f-5714-4374-b86f-c4960f8f1463 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:18.467857 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e016f-5714-4374-b86f-c4960f8f1463 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:18.468175 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e016f-5714-4374-b86f-c4960f8f1463 None admin] PATH_INFO: `/v3/users/be1d41cd94ee47eabe65a1747ef1e5b1` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:18.469420 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4e016f-5714-4374-b86f-c4960f8f1463 None admin] RBAC: Authorizing `identity:get_user(user_id=be1d41cd94ee47eabe65a1747ef1e5b1)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:18.470928 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4e016f-5714-4374-b86f-c4960f8f1463 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:18.474642 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 111/232] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Sep 18 00:42:18 2022] GET /identity/v3/users/be1d41cd94ee47eabe65a1747ef1e5b1 => generated 283 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:18.479070 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7cfa32-5a93-4d89-a855-0f71cdf231ee None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:18.501819 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:18.601223 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7cfa32-5a93-4d89-a855-0f71cdf231ee None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:18.639185 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268bc5a8-305c-4084-a61c-362acbedab79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:18.639854 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268bc5a8-305c-4084-a61c-362acbedab79 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:18.640176 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268bc5a8-305c-4084-a61c-362acbedab79 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:18.640445 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268bc5a8-305c-4084-a61c-362acbedab79 None admin] PATH_INFO: `/v3/projects/14cc5534b3054dfbbc19e546f4d51538` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:18.641654 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268bc5a8-305c-4084-a61c-362acbedab79 None admin] RBAC: Authorizing `identity:get_project(project_id=14cc5534b3054dfbbc19e546f4d51538)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:18.643139 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268bc5a8-305c-4084-a61c-362acbedab79 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:18.649440 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 122/233] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Sep 18 00:42:18 2022] GET /identity/v3/projects/14cc5534b3054dfbbc19e546f4d51538 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:18.651768 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4e016f-5714-4374-b86f-c4960f8f1463 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:18.715216 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5bb838-7418-48f1-b542-f90b1cd84d85 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:18.715586 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5bb838-7418-48f1-b542-f90b1cd84d85 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:18.716131 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5bb838-7418-48f1-b542-f90b1cd84d85 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:18.718711 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 123/234] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:42:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:42:18.729511 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3dd4f-29be-4157-9fe9-e41c71c06d0b None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:18.730290 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3dd4f-29be-4157-9fe9-e41c71c06d0b None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:18.730731 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3dd4f-29be-4157-9fe9-e41c71c06d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:18.768149 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-f5a3dd4f-29be-4157-9fe9-e41c71c06d0b None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:42:18.768149 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-f5a3dd4f-29be-4157-9fe9-e41c71c06d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:42:18.844934 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4e016f-5714-4374-b86f-c4960f8f1463 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:18.896898 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 124/235] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:42:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 00:42:18.945233 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14fd7e-5108-438a-bebb-867160807ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:18.946799 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14fd7e-5108-438a-bebb-867160807ff1 None admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:18.947616 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14fd7e-5108-438a-bebb-867160807ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:18.948403 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14fd7e-5108-438a-bebb-867160807ff1 None admin] PATH_INFO: `/v3/projects/14cc5534b3054dfbbc19e546f4d51538/users/be1d41cd94ee47eabe65a1747ef1e5b1/roles/e2a7bd363c424c5380514254ad1cc522` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:18.958876 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a14fd7e-5108-438a-bebb-867160807ff1 None admin] RBAC: Authorizing `identity:create_grant(project_id=14cc5534b3054dfbbc19e546f4d51538, user_id=be1d41cd94ee47eabe65a1747ef1e5b1, role_id=e2a7bd363c424c5380514254ad1cc522)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:18.961553 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a14fd7e-5108-438a-bebb-867160807ff1 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:18.990822 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b752589-92ed-487d-9c65-811753e5310b None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:18.991308 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b752589-92ed-487d-9c65-811753e5310b None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:18.991795 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b752589-92ed-487d-9c65-811753e5310b None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:18.994417 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 125/236] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:42:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 18 00:42:18.999778 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 112/237] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Sep 18 00:42:18 2022] PUT /identity/v3/projects/14cc5534b3054dfbbc19e546f4d51538/users/be1d41cd94ee47eabe65a1747ef1e5b1/roles/e2a7bd363c424c5380514254ad1cc522 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 00:42:19.002482 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab8ca9-1d77-4971-855f-54a2a9c3e271 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:19.003366 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab8ca9-1d77-4971-855f-54a2a9c3e271 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:19.004082 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab8ca9-1d77-4971-855f-54a2a9c3e271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:19.052008 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-51ab8ca9-1d77-4971-855f-54a2a9c3e271 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:42:19.054552 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-51ab8ca9-1d77-4971-855f-54a2a9c3e271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:42:19.085871 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:19.228368 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 126/238] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:42:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 00:42:19.288273 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14fd7e-5108-438a-bebb-867160807ff1 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:19.338562 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:19.526089 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14fd7e-5108-438a-bebb-867160807ff1 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:19.555411 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab8ca9-1d77-4971-855f-54a2a9c3e271 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:19.613573 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2362b6-948a-40d0-8561-bdd8e5c797ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:19.614289 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2362b6-948a-40d0-8561-bdd8e5c797ef None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:19.614620 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2362b6-948a-40d0-8561-bdd8e5c797ef None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:19.614945 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2362b6-948a-40d0-8561-bdd8e5c797ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:19.616328 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2362b6-948a-40d0-8561-bdd8e5c797ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:19.618039 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2362b6-948a-40d0-8561-bdd8e5c797ef None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:19.620101 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 113/239] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:42:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:19.621442 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2b3c1-3f61-4960-a856-e3916fb4f4e2 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:19.621754 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2b3c1-3f61-4960-a856-e3916fb4f4e2 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:19.622035 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2b3c1-3f61-4960-a856-e3916fb4f4e2 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:19.623611 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 114/240] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:42:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:42:19.629325 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d387133-25ad-494a-844e-47d9acebcbcb None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:19.629792 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d387133-25ad-494a-844e-47d9acebcbcb None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:19.630614 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d387133-25ad-494a-844e-47d9acebcbcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:19.651383 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-5d387133-25ad-494a-844e-47d9acebcbcb None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:42:19.652705 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-5d387133-25ad-494a-844e-47d9acebcbcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:42:19.683640 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab8ca9-1d77-4971-855f-54a2a9c3e271 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:19.743930 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 115/241] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:42:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 18 00:42:19.745537 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d387133-25ad-494a-844e-47d9acebcbcb None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:19.753615 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a98b2-8ece-4a00-b595-f6693ffb8db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:19.754437 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a98b2-8ece-4a00-b595-f6693ffb8db3 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:19.754812 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a98b2-8ece-4a00-b595-f6693ffb8db3 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:19.759923 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a98b2-8ece-4a00-b595-f6693ffb8db3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:19.797701 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53a98b2-8ece-4a00-b595-f6693ffb8db3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:42:19.820996 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-a53a98b2-8ece-4a00-b595-f6693ffb8db3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 18 00:42:19.820996 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:42:19.820996 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:42:19.820996 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:42:19.820996 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:42:19.820996 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:42:19.820996 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:42:19.820996 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:42:19.820996 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:42:19.820996 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:42:19.820996 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:42:19.820996 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:42:19.820996 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:42:19.820996 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:42:19.820996 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:42:19.820996 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:42:19.821909 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:42:19.821909 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:42:19.821909 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:42:19.821909 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:42:19.821909 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:42:19.821909 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:42:19.821909 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:42:19.821909 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:42:19.821909 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:42:19.821909 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:42:19.821909 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:42:19.821909 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:42:19.821909 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:42:19.821909 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:42:19.821909 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:42:19.821909 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:42:19.822676 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:42:19.822676 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:42:19.822676 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:42:19.822676 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:42:19.822676 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:42:19.822676 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:42:19.822676 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:42:19.822676 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:42:19.822676 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:42:19.822676 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:42:19.822676 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 18 00:42:19.822676 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:42:19.824666 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 127/242] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Sep 18 00:42:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 00:42:19.841487 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a98b2-8ece-4a00-b595-f6693ffb8db3 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:19.848764 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:19.865334 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:20.067835 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d387133-25ad-494a-844e-47d9acebcbcb None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:20.112527 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc688f75-a249-4bb7-aa5f-d1a67343e757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:20.113527 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc688f75-a249-4bb7-aa5f-d1a67343e757 None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:20.113968 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc688f75-a249-4bb7-aa5f-d1a67343e757 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:20.114972 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc688f75-a249-4bb7-aa5f-d1a67343e757 None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:20.115840 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc688f75-a249-4bb7-aa5f-d1a67343e757 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:20.117727 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc688f75-a249-4bb7-aa5f-d1a67343e757 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:20.149118 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 116/243] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Sep 18 00:42:19 2022] POST /identity/v3/users => generated 293 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 00:42:20.150387 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc688f75-a249-4bb7-aa5f-d1a67343e757 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:20.159602 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a98b2-8ece-4a00-b595-f6693ffb8db3 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:20.289695 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c5a695-6758-4d62-87e6-08439bfc5b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:20.290608 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5a695-6758-4d62-87e6-08439bfc5b3b None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:20.290954 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5a695-6758-4d62-87e6-08439bfc5b3b None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:20.291452 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5a695-6758-4d62-87e6-08439bfc5b3b None admin] PATH_INFO: `/v3/roles` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:20.292985 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c5a695-6758-4d62-87e6-08439bfc5b3b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:42:20.293504 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c5a695-6758-4d62-87e6-08439bfc5b3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:20.296437 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c5a695-6758-4d62-87e6-08439bfc5b3b None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:20.306801 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:20.319069 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 128/244] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Sep 18 00:42:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 479 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:20.326656 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c5a695-6758-4d62-87e6-08439bfc5b3b None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:20.346954 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc688f75-a249-4bb7-aa5f-d1a67343e757 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:20.444678 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:20.471463 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be33f716-1208-4598-a147-9a904783bdf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:20.472555 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be33f716-1208-4598-a147-9a904783bdf7 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:20.473174 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be33f716-1208-4598-a147-9a904783bdf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:20.473518 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be33f716-1208-4598-a147-9a904783bdf7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:20.495915 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c5a695-6758-4d62-87e6-08439bfc5b3b None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:20.522411 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be33f716-1208-4598-a147-9a904783bdf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:42:20.537138 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-be33f716-1208-4598-a147-9a904783bdf7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 18 00:42:20.537138 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:42:20.537138 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:42:20.537138 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:42:20.537138 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:42:20.537138 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:42:20.537138 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:42:20.537138 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:42:20.537138 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:42:20.537138 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:42:20.537138 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:42:20.537138 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:42:20.537138 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:42:20.537138 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:42:20.537138 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:42:20.537138 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:42:20.538489 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:42:20.538489 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:42:20.538489 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:42:20.538489 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:42:20.538489 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:42:20.538489 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:42:20.538489 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:42:20.538489 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:42:20.538489 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:42:20.538489 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:42:20.538489 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:42:20.538489 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:42:20.538489 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:42:20.538489 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:42:20.538489 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:42:20.538489 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:42:20.539252 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:42:20.539252 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:42:20.539252 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:42:20.539252 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:42:20.539252 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:42:20.539252 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:42:20.539252 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:42:20.539252 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:42:20.539252 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:42:20.539252 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:42:20.539252 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 18 00:42:20.539252 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:42:20.542950 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 117/245] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Sep 18 00:42:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 393 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:42:20.549350 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9307d5-35a3-49d6-af46-bbeede5ff0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:20.550424 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9307d5-35a3-49d6-af46-bbeede5ff0db None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:20.550860 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9307d5-35a3-49d6-af46-bbeede5ff0db None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:20.551310 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9307d5-35a3-49d6-af46-bbeede5ff0db None admin] PATH_INFO: `/v3/users/bd6d825724194faa88ac5fb5e54f7500` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:20.553021 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be33f716-1208-4598-a147-9a904783bdf7 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:20.580357 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9307d5-35a3-49d6-af46-bbeede5ff0db None admin] RBAC: Authorizing `identity:get_user(user_id=bd6d825724194faa88ac5fb5e54f7500)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:20.583634 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9307d5-35a3-49d6-af46-bbeede5ff0db None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:20.588711 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 129/246] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Sep 18 00:42:20 2022] GET /identity/v3/users/bd6d825724194faa88ac5fb5e54f7500 => generated 297 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:20.597391 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9307d5-35a3-49d6-af46-bbeede5ff0db None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:20.685175 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be33f716-1208-4598-a147-9a904783bdf7 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:20.725855 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c202e-1057-4fe7-ad57-c7ea9d7c4712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:20.727019 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c202e-1057-4fe7-ad57-c7ea9d7c4712 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:20.727513 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c202e-1057-4fe7-ad57-c7ea9d7c4712 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:20.728029 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c202e-1057-4fe7-ad57-c7ea9d7c4712 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:20.728921 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914c202e-1057-4fe7-ad57-c7ea9d7c4712 None admin] RBAC: Adding query filter params (name=member) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:42:20.729451 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914c202e-1057-4fe7-ad57-c7ea9d7c4712 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:20.731133 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914c202e-1057-4fe7-ad57-c7ea9d7c4712 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:20.743037 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 118/247] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Sep 18 00:42:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:20.748990 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c202e-1057-4fe7-ad57-c7ea9d7c4712 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:20.762685 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:20.804817 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9307d5-35a3-49d6-af46-bbeede5ff0db None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:20.851641 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:20.872359 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9184f9-fb04-4899-b1b8-e0ca9bffdfda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:20.873396 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9184f9-fb04-4899-b1b8-e0ca9bffdfda None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:20.875225 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9184f9-fb04-4899-b1b8-e0ca9bffdfda None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:20.875225 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9184f9-fb04-4899-b1b8-e0ca9bffdfda None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:20.939999 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c202e-1057-4fe7-ad57-c7ea9d7c4712 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:21.006121 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9184f9-fb04-4899-b1b8-e0ca9bffdfda None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:21.008270 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb87568e-dd79-4244-80b8-fbc34ce2d8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:21.008788 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9184f9-fb04-4899-b1b8-e0ca9bffdfda None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:21.010092 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb87568e-dd79-4244-80b8-fbc34ce2d8eb None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:21.010947 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb87568e-dd79-4244-80b8-fbc34ce2d8eb None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:21.011727 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb87568e-dd79-4244-80b8-fbc34ce2d8eb None admin] PATH_INFO: `/v3/users/3f62ac376ca84b38b71691623699f6d8` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:21.014540 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb87568e-dd79-4244-80b8-fbc34ce2d8eb None admin] RBAC: Authorizing `identity:get_user(user_id=3f62ac376ca84b38b71691623699f6d8)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:21.017636 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb87568e-dd79-4244-80b8-fbc34ce2d8eb None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:21.021229 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 119/248] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Sep 18 00:42:20 2022] GET /identity/v3/users/3f62ac376ca84b38b71691623699f6d8 => generated 297 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:42:21.030817 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb87568e-dd79-4244-80b8-fbc34ce2d8eb None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:21.167083 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 130/249] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Sep 18 00:42:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 18 00:42:21.175006 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9184f9-fb04-4899-b1b8-e0ca9bffdfda None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:21.194287 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:21.218787 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:21.250433 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb87568e-dd79-4244-80b8-fbc34ce2d8eb None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:21.323780 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9184f9-fb04-4899-b1b8-e0ca9bffdfda None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:21.324191 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f729f0-df92-46a6-a8be-c363a9d0ccd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:21.324817 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f729f0-df92-46a6-a8be-c363a9d0ccd8 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:21.325094 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f729f0-df92-46a6-a8be-c363a9d0ccd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:21.325430 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f729f0-df92-46a6-a8be-c363a9d0ccd8 None admin] PATH_INFO: `/v3/projects/14cc5534b3054dfbbc19e546f4d51538` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:21.326487 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f729f0-df92-46a6-a8be-c363a9d0ccd8 None admin] RBAC: Authorizing `identity:get_project(project_id=14cc5534b3054dfbbc19e546f4d51538)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:21.328055 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f729f0-df92-46a6-a8be-c363a9d0ccd8 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:21.330117 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 120/250] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Sep 18 00:42:21 2022] GET /identity/v3/projects/14cc5534b3054dfbbc19e546f4d51538 => generated 302 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:21.340699 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f729f0-df92-46a6-a8be-c363a9d0ccd8 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:21.396454 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fde4f0-9fad-4f88-a050-533b689f215d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:21.398010 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fde4f0-9fad-4f88-a050-533b689f215d None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:21.398775 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fde4f0-9fad-4f88-a050-533b689f215d None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:21.399532 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fde4f0-9fad-4f88-a050-533b689f215d None admin] PATH_INFO: `/v3/projects/14cc5534b3054dfbbc19e546f4d51538` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:21.403861 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fde4f0-9fad-4f88-a050-533b689f215d None admin] RBAC: Authorizing `identity:get_project(project_id=14cc5534b3054dfbbc19e546f4d51538)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:21.407172 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fde4f0-9fad-4f88-a050-533b689f215d None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:21.411026 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 131/251] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Sep 18 00:42:21 2022] GET /identity/v3/projects/14cc5534b3054dfbbc19e546f4d51538 => generated 302 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:21.418887 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fde4f0-9fad-4f88-a050-533b689f215d None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:21.519473 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f729f0-df92-46a6-a8be-c363a9d0ccd8 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:21.533131 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:21.544436 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fde4f0-9fad-4f88-a050-533b689f215d None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:21.585493 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fcc35e-ba43-46b4-bf4c-6b6c0bb68280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:21.586319 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fcc35e-ba43-46b4-bf4c-6b6c0bb68280 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:21.586602 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fcc35e-ba43-46b4-bf4c-6b6c0bb68280 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:21.586876 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fcc35e-ba43-46b4-bf4c-6b6c0bb68280 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:21.588161 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fcc35e-ba43-46b4-bf4c-6b6c0bb68280 None admin] RBAC: Adding query filter params (role.id=21a002d535ce432597d9291135265677, scope.project.id=14cc5534b3054dfbbc19e546f4d51538, user.id=bd6d825724194faa88ac5fb5e54f7500) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:42:21.588474 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fcc35e-ba43-46b4-bf4c-6b6c0bb68280 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:21.590575 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fcc35e-ba43-46b4-bf4c-6b6c0bb68280 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:21.596173 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad1d5a8-97f1-4de5-9993-b8b17a8b2166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:21.597418 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1d5a8-97f1-4de5-9993-b8b17a8b2166 None admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:21.598008 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1d5a8-97f1-4de5-9993-b8b17a8b2166 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:21.598571 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1d5a8-97f1-4de5-9993-b8b17a8b2166 None admin] PATH_INFO: `/v3/projects/14cc5534b3054dfbbc19e546f4d51538/users/3f62ac376ca84b38b71691623699f6d8/roles/59d7218a321b4c20bc1996494a48a2a1` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:21.602589 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad1d5a8-97f1-4de5-9993-b8b17a8b2166 None admin] RBAC: Authorizing `identity:create_grant(project_id=14cc5534b3054dfbbc19e546f4d51538, user_id=3f62ac376ca84b38b71691623699f6d8, role_id=59d7218a321b4c20bc1996494a48a2a1)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:21.604040 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 132/252] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Sep 18 00:42:21 2022] GET /identity/v3/role_assignments?user.id=bd6d825724194faa88ac5fb5e54f7500&scope.project.id=14cc5534b3054dfbbc19e546f4d51538&role.id=21a002d535ce432597d9291135265677 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:42:21.605549 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78f333-61b5-405c-8bc9-865bcdda5cf6 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:21.605835 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78f333-61b5-405c-8bc9-865bcdda5cf6 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:21.605984 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad1d5a8-97f1-4de5-9993-b8b17a8b2166 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:21.606124 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78f333-61b5-405c-8bc9-865bcdda5cf6 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:21.607691 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 133/253] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:42:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:42:21.616439 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a4e20-cc5f-4469-af06-57aa5411da55 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:21.616787 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a4e20-cc5f-4469-af06-57aa5411da55 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:21.616985 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a4e20-cc5f-4469-af06-57aa5411da55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:21.653134 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 121/254] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Sep 18 00:42:21 2022] PUT /identity/v3/projects/14cc5534b3054dfbbc19e546f4d51538/users/3f62ac376ca84b38b71691623699f6d8/roles/59d7218a321b4c20bc1996494a48a2a1 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 00:42:21.654284 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-7a1a4e20-cc5f-4469-af06-57aa5411da55 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:42:21.655664 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-7a1a4e20-cc5f-4469-af06-57aa5411da55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:42:21.795355 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 134/255] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:42:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 18 00:42:22.111177 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17d078-4f08-439e-ab8e-d5ccd08d72f5 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:22.111651 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17d078-4f08-439e-ab8e-d5ccd08d72f5 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:22.112174 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17d078-4f08-439e-ab8e-d5ccd08d72f5 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:22.115764 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 122/256] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:42:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:42:22.124208 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca7fe78-2941-4404-97cc-b3637751179e None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:22.124702 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca7fe78-2941-4404-97cc-b3637751179e None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:22.125189 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca7fe78-2941-4404-97cc-b3637751179e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:22.167076 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-3ca7fe78-2941-4404-97cc-b3637751179e None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:42:22.169172 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-3ca7fe78-2941-4404-97cc-b3637751179e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:42:22.320441 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 135/257] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:42:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 18 00:42:22.448662 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d17d078-4f08-439e-ab8e-d5ccd08d72f5 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:22.453112 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:22.603645 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d17d078-4f08-439e-ab8e-d5ccd08d72f5 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:22.647075 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57954ff-5d19-4da6-b928-39e169f6426d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:22.647744 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57954ff-5d19-4da6-b928-39e169f6426d None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:22.648052 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57954ff-5d19-4da6-b928-39e169f6426d None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:22.648325 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57954ff-5d19-4da6-b928-39e169f6426d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:22.665086 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57954ff-5d19-4da6-b928-39e169f6426d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:42:22.670884 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-a57954ff-5d19-4da6-b928-39e169f6426d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 00:42:22.670884 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:42:22.670884 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:42:22.670884 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:42:22.670884 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:42:22.670884 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:42:22.670884 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:42:22.670884 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:42:22.670884 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:42:22.670884 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:42:22.670884 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:42:22.670884 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:42:22.670884 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:42:22.670884 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:42:22.670884 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:42:22.670884 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:42:22.672613 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:42:22.672613 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:42:22.672613 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:42:22.672613 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:42:22.672613 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:42:22.672613 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:42:22.672613 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:42:22.672613 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:42:22.672613 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:42:22.672613 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:42:22.672613 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:42:22.672613 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:42:22.672613 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:42:22.672613 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:42:22.672613 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:42:22.672613 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:42:22.674174 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:42:22.674174 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:42:22.674174 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:42:22.674174 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:42:22.674174 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:42:22.674174 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:42:22.674174 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:42:22.674174 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:42:22.674174 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:42:22.674174 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:42:22.674174 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 00:42:22.674174 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:42:22.674174 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 123/258] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Sep 18 00:42:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:42:22.678844 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca7fe78-2941-4404-97cc-b3637751179e None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:22.731199 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:22.903532 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca7fe78-2941-4404-97cc-b3637751179e None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:22.955279 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce4be2-afb8-4b43-a37e-4959d9996707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:22.955923 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce4be2-afb8-4b43-a37e-4959d9996707 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:22.956214 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce4be2-afb8-4b43-a37e-4959d9996707 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:22.956492 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce4be2-afb8-4b43-a37e-4959d9996707 None admin] PATH_INFO: `/v3/roles` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:22.957174 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce4be2-afb8-4b43-a37e-4959d9996707 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:42:22.957481 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce4be2-afb8-4b43-a37e-4959d9996707 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:22.959434 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce4be2-afb8-4b43-a37e-4959d9996707 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:22.972283 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 136/259] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Sep 18 00:42:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:22.981582 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57954ff-5d19-4da6-b928-39e169f6426d None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:23.030791 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce4be2-afb8-4b43-a37e-4959d9996707 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:23.182214 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:23.252986 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:23.276672 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57954ff-5d19-4da6-b928-39e169f6426d None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:23.309879 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce4be2-afb8-4b43-a37e-4959d9996707 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:23.354197 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b77d43-7550-4dcd-bcb1-dea4ad3be2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:23.355864 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b77d43-7550-4dcd-bcb1-dea4ad3be2c5 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:23.356557 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b77d43-7550-4dcd-bcb1-dea4ad3be2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:23.357829 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b77d43-7550-4dcd-bcb1-dea4ad3be2c5 None admin] PATH_INFO: `/v3/users/be1d41cd94ee47eabe65a1747ef1e5b1` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:23.360327 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b77d43-7550-4dcd-bcb1-dea4ad3be2c5 None admin] RBAC: Authorizing `identity:get_user(user_id=be1d41cd94ee47eabe65a1747ef1e5b1)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:23.363215 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b77d43-7550-4dcd-bcb1-dea4ad3be2c5 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:23.367499 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 124/260] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Sep 18 00:42:22 2022] GET /identity/v3/users/be1d41cd94ee47eabe65a1747ef1e5b1 => generated 283 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:23.378238 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b77d43-7550-4dcd-bcb1-dea4ad3be2c5 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:23.392563 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6f9a89-6bad-4134-8044-d3f9eabcb441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:23.393232 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f9a89-6bad-4134-8044-d3f9eabcb441 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:23.393518 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f9a89-6bad-4134-8044-d3f9eabcb441 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:23.393795 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f9a89-6bad-4134-8044-d3f9eabcb441 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:23.435298 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6f9a89-6bad-4134-8044-d3f9eabcb441 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:42:23.442247 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-4f6f9a89-6bad-4134-8044-d3f9eabcb441 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 18 00:42:23.442247 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:42:23.442247 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:42:23.442247 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:42:23.442247 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:42:23.442247 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:42:23.442247 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:42:23.442247 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:42:23.442247 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:42:23.442247 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:42:23.442247 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:42:23.442247 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:42:23.442247 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:42:23.442247 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:42:23.442247 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:42:23.442247 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:42:23.444544 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:42:23.444544 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:42:23.444544 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:42:23.444544 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:42:23.444544 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:42:23.444544 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:42:23.444544 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:42:23.444544 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:42:23.444544 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:42:23.444544 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:42:23.444544 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:42:23.444544 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:42:23.444544 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:42:23.444544 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:42:23.444544 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:42:23.444544 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:42:23.446114 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:42:23.446114 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:42:23.446114 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:42:23.446114 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:42:23.446114 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:42:23.446114 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:42:23.446114 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:42:23.446114 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:42:23.446114 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:42:23.446114 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:42:23.446114 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 18 00:42:23.446114 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:42:23.453769 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 137/261] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Sep 18 00:42:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 424 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 00:42:23.454846 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6f9a89-6bad-4134-8044-d3f9eabcb441 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:23.664524 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b77d43-7550-4dcd-bcb1-dea4ad3be2c5 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:23.731418 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:23.743455 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e0d45-2545-48d0-b506-6fa422a51623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:23.744138 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e0d45-2545-48d0-b506-6fa422a51623 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:23.744426 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e0d45-2545-48d0-b506-6fa422a51623 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:23.744690 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e0d45-2545-48d0-b506-6fa422a51623 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:23.799972 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6f9a89-6bad-4134-8044-d3f9eabcb441 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:23.888155 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78e0d45-2545-48d0-b506-6fa422a51623 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:23.889698 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78e0d45-2545-48d0-b506-6fa422a51623 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:23.943027 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e386466-9e8a-4bac-864b-f36f7c7ea3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:23.944026 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e386466-9e8a-4bac-864b-f36f7c7ea3b8 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:23.944534 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e386466-9e8a-4bac-864b-f36f7c7ea3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:23.945043 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e386466-9e8a-4bac-864b-f36f7c7ea3b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:23.946323 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e386466-9e8a-4bac-864b-f36f7c7ea3b8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:42:23.946872 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e386466-9e8a-4bac-864b-f36f7c7ea3b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:23.954034 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e386466-9e8a-4bac-864b-f36f7c7ea3b8 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:23.968505 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:23.984673 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 138/262] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Sep 18 00:42:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 530 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:23.994059 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e386466-9e8a-4bac-864b-f36f7c7ea3b8 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:24.087565 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 125/263] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Sep 18 00:42:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 711 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 00:42:24.093855 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e0d45-2545-48d0-b506-6fa422a51623 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:24.157585 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:24.301234 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e0d45-2545-48d0-b506-6fa422a51623 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:24.362702 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e1fc3-55ca-462a-9f98-b9919c5d854a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:24.363370 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e1fc3-55ca-462a-9f98-b9919c5d854a None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:24.363656 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e1fc3-55ca-462a-9f98-b9919c5d854a None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:24.363954 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e1fc3-55ca-462a-9f98-b9919c5d854a None admin] PATH_INFO: `/v3/projects/14cc5534b3054dfbbc19e546f4d51538` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:24.368761 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990e1fc3-55ca-462a-9f98-b9919c5d854a None admin] RBAC: Authorizing `identity:get_project(project_id=14cc5534b3054dfbbc19e546f4d51538)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:24.370358 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990e1fc3-55ca-462a-9f98-b9919c5d854a None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:24.372450 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 126/264] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Sep 18 00:42:24 2022] GET /identity/v3/projects/14cc5534b3054dfbbc19e546f4d51538 => generated 302 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:42:24.378473 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e1fc3-55ca-462a-9f98-b9919c5d854a None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:24.408287 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e386466-9e8a-4bac-864b-f36f7c7ea3b8 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:24.593267 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff348964-6104-48fe-ab50-0107c2eb4fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:24.594266 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff348964-6104-48fe-ab50-0107c2eb4fa6 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:24.594757 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff348964-6104-48fe-ab50-0107c2eb4fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:24.595245 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff348964-6104-48fe-ab50-0107c2eb4fa6 None admin] PATH_INFO: `/v3/users/be1d41cd94ee47eabe65a1747ef1e5b1` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:24.597792 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff348964-6104-48fe-ab50-0107c2eb4fa6 None admin] RBAC: Authorizing `identity:get_user(user_id=be1d41cd94ee47eabe65a1747ef1e5b1)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:24.600685 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff348964-6104-48fe-ab50-0107c2eb4fa6 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:24.607108 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:24.611156 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 139/265] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Sep 18 00:42:23 2022] GET /identity/v3/users/be1d41cd94ee47eabe65a1747ef1e5b1 => generated 283 bytes in 618 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:42:24.613061 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff348964-6104-48fe-ab50-0107c2eb4fa6 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:24.622635 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e1fc3-55ca-462a-9f98-b9919c5d854a None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:24.716757 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6ca52a-3853-444d-92c3-07255bc7b6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:24.717734 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ca52a-3853-444d-92c3-07255bc7b6cd None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:24.717734 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ca52a-3853-444d-92c3-07255bc7b6cd None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:24.717998 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ca52a-3853-444d-92c3-07255bc7b6cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:24.718649 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6ca52a-3853-444d-92c3-07255bc7b6cd None admin] RBAC: Adding query filter params (role.id=591d4711dc204cf98003c8b7d7558506, scope.project.id=14cc5534b3054dfbbc19e546f4d51538, user.id=be1d41cd94ee47eabe65a1747ef1e5b1) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:42:24.718958 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6ca52a-3853-444d-92c3-07255bc7b6cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:24.720591 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6ca52a-3853-444d-92c3-07255bc7b6cd None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:24.727920 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 127/266] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Sep 18 00:42:24 2022] GET /identity/v3/role_assignments?user.id=be1d41cd94ee47eabe65a1747ef1e5b1&scope.project.id=14cc5534b3054dfbbc19e546f4d51538&role.id=591d4711dc204cf98003c8b7d7558506 => generated 608 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:42:24.858615 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:24.952334 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff348964-6104-48fe-ab50-0107c2eb4fa6 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:25.041218 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd51c9-a705-4c7f-a6c5-b53f8abe0fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:25.042521 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd51c9-a705-4c7f-a6c5-b53f8abe0fa5 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:25.043022 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd51c9-a705-4c7f-a6c5-b53f8abe0fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:25.043504 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd51c9-a705-4c7f-a6c5-b53f8abe0fa5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:25.203454 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fd51c9-a705-4c7f-a6c5-b53f8abe0fa5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:25.206338 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fd51c9-a705-4c7f-a6c5-b53f8abe0fa5 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:25.370366 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:25.458339 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 140/267] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Sep 18 00:42:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 846 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 00:42:25.465370 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7a083-60a8-4b28-8df9-33586a1face4 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:25.465752 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7a083-60a8-4b28-8df9-33586a1face4 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:25.465901 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd51c9-a705-4c7f-a6c5-b53f8abe0fa5 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:25.466037 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7a083-60a8-4b28-8df9-33586a1face4 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:25.467306 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 128/268] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:42:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 18 00:42:25.481388 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91927372-bc23-45df-b009-0a40028192a6 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:25.481886 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91927372-bc23-45df-b009-0a40028192a6 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:25.482429 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91927372-bc23-45df-b009-0a40028192a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:25.528614 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-91927372-bc23-45df-b009-0a40028192a6 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:42:25.530002 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-91927372-bc23-45df-b009-0a40028192a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:42:25.689180 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd51c9-a705-4c7f-a6c5-b53f8abe0fa5 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:25.701817 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 129/269] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:42:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 18 00:42:25.754074 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8154ff88-79c3-4c58-addc-7349f7ce6b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:25.754667 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8154ff88-79c3-4c58-addc-7349f7ce6b7b None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:25.755547 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8154ff88-79c3-4c58-addc-7349f7ce6b7b None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:25.755831 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8154ff88-79c3-4c58-addc-7349f7ce6b7b None admin] PATH_INFO: `/v3/projects/14cc5534b3054dfbbc19e546f4d51538` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:25.757394 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8154ff88-79c3-4c58-addc-7349f7ce6b7b None admin] RBAC: Authorizing `identity:get_project(project_id=14cc5534b3054dfbbc19e546f4d51538)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:25.758996 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8154ff88-79c3-4c58-addc-7349f7ce6b7b None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:25.760899 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 141/270] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Sep 18 00:42:25 2022] GET /identity/v3/projects/14cc5534b3054dfbbc19e546f4d51538 => generated 302 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:42:25.770617 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91927372-bc23-45df-b009-0a40028192a6 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:25.920756 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:25.930508 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91927372-bc23-45df-b009-0a40028192a6 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:25.981142 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcf95f4-cad4-4284-aa2e-097839c34f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:25.982178 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf95f4-cad4-4284-aa2e-097839c34f34 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:25.982670 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf95f4-cad4-4284-aa2e-097839c34f34 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:25.983146 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf95f4-cad4-4284-aa2e-097839c34f34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:25.984526 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcf95f4-cad4-4284-aa2e-097839c34f34 None admin] RBAC: Adding query filter params (role.id=e2a7bd363c424c5380514254ad1cc522, scope.project.id=14cc5534b3054dfbbc19e546f4d51538, user.id=be1d41cd94ee47eabe65a1747ef1e5b1) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:42:25.985076 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcf95f4-cad4-4284-aa2e-097839c34f34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:25.987840 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcf95f4-cad4-4284-aa2e-097839c34f34 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:26.004219 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 130/271] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Sep 18 00:42:25 2022] GET /identity/v3/role_assignments?user.id=be1d41cd94ee47eabe65a1747ef1e5b1&scope.project.id=14cc5534b3054dfbbc19e546f4d51538&role.id=e2a7bd363c424c5380514254ad1cc522 => generated 608 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:26.017664 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f68439-8051-41bb-a001-85044c916e64 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:26.018089 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f68439-8051-41bb-a001-85044c916e64 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:26.018310 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f68439-8051-41bb-a001-85044c916e64 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:26.020110 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 142/272] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:42:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:42:26.028819 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28943e2-3d42-4ac0-9d2c-c9708a53c9cb None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:26.029255 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28943e2-3d42-4ac0-9d2c-c9708a53c9cb None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:26.029656 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28943e2-3d42-4ac0-9d2c-c9708a53c9cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:26.081818 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-a28943e2-3d42-4ac0-9d2c-c9708a53c9cb None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:42:26.084406 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-a28943e2-3d42-4ac0-9d2c-c9708a53c9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:42:26.251545 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 131/273] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:42:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 18 00:42:26.354382 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f68439-8051-41bb-a001-85044c916e64 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:26.426480 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:26.559165 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f68439-8051-41bb-a001-85044c916e64 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:26.594402 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323da09-8bdd-45fa-bb44-59dd539de858 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:26.594811 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323da09-8bdd-45fa-bb44-59dd539de858 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:26.594995 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323da09-8bdd-45fa-bb44-59dd539de858 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:26.596744 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 132/274] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:42:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:42:26.603058 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba025c-2340-4655-8b04-3faf1f023658 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:26.603758 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba025c-2340-4655-8b04-3faf1f023658 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:26.604318 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba025c-2340-4655-8b04-3faf1f023658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:26.632367 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d509e2-cc2f-4a76-b833-c83da26fe880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:26.632920 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d509e2-cc2f-4a76-b833-c83da26fe880 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:26.633194 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d509e2-cc2f-4a76-b833-c83da26fe880 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:26.633465 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d509e2-cc2f-4a76-b833-c83da26fe880 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:26.634638 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d509e2-cc2f-4a76-b833-c83da26fe880 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:26.636157 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d509e2-cc2f-4a76-b833-c83da26fe880 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:26.642804 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 143/275] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:42:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:26.644980 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d509e2-cc2f-4a76-b833-c83da26fe880 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:26.653180 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-e0ba025c-2340-4655-8b04-3faf1f023658 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:42:26.656025 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-e0ba025c-2340-4655-8b04-3faf1f023658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:42:26.774199 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d509e2-cc2f-4a76-b833-c83da26fe880 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:26.788729 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:26.798115 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 133/276] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:42:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 18 00:42:26.806915 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdbb8cc-21ad-4519-b5ff-da774b8e6c90 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:26.807358 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdbb8cc-21ad-4519-b5ff-da774b8e6c90 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:26.807797 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdbb8cc-21ad-4519-b5ff-da774b8e6c90 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:26.810768 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 134/277] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:42:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 18 00:42:26.822027 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a3159-2776-42b0-a5c4-9251b2d5165c None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:26.822538 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a3159-2776-42b0-a5c4-9251b2d5165c None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:26.823125 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a3159-2776-42b0-a5c4-9251b2d5165c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:26.837600 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec3e22-f9c7-46b5-a345-360fb456d101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:26.838849 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec3e22-f9c7-46b5-a345-360fb456d101 None admin] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:26.839477 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec3e22-f9c7-46b5-a345-360fb456d101 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:26.840985 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec3e22-f9c7-46b5-a345-360fb456d101 None admin] PATH_INFO: `/v3/users` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:26.842368 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ec3e22-f9c7-46b5-a345-360fb456d101 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:26.844191 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ec3e22-f9c7-46b5-a345-360fb456d101 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:26.849342 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-3f5a3159-2776-42b0-a5c4-9251b2d5165c None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:42:26.850834 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-3f5a3159-2776-42b0-a5c4-9251b2d5165c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:42:26.871138 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:26.880218 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 144/278] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Sep 18 00:42:26 2022] POST /identity/v3/users => generated 293 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 00:42:26.880218 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec3e22-f9c7-46b5-a345-360fb456d101 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:26.992874 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 135/279] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:42:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 00:42:27.094935 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec3e22-f9c7-46b5-a345-360fb456d101 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:27.135841 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac1f19-2031-4eb6-a583-1ad387ad3126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:27.136576 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac1f19-2031-4eb6-a583-1ad387ad3126 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:27.136859 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac1f19-2031-4eb6-a583-1ad387ad3126 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:27.137124 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac1f19-2031-4eb6-a583-1ad387ad3126 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:27.151164 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ac1f19-2031-4eb6-a583-1ad387ad3126 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:42:27.156810 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-15ac1f19-2031-4eb6-a583-1ad387ad3126 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 18 00:42:27.156810 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:42:27.156810 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:42:27.156810 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:42:27.156810 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:42:27.156810 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:42:27.156810 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:42:27.156810 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:42:27.156810 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:42:27.156810 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:42:27.156810 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:42:27.156810 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:42:27.156810 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:42:27.156810 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:42:27.156810 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:42:27.156810 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:42:27.158472 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:42:27.158472 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:42:27.158472 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:42:27.158472 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:42:27.158472 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:42:27.158472 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:42:27.158472 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:42:27.158472 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:42:27.158472 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:42:27.158472 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:42:27.158472 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:42:27.158472 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:42:27.158472 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:42:27.158472 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:42:27.158472 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:42:27.158472 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:42:27.160020 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:42:27.160020 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:42:27.160020 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:42:27.160020 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:42:27.160020 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:42:27.160020 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:42:27.160020 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:42:27.160020 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:42:27.160020 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:42:27.160020 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:42:27.160020 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 18 00:42:27.160020 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:42:27.160020 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 145/280] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Sep 18 00:42:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:42:27.165569 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a3159-2776-42b0-a5c4-9251b2d5165c None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:27.328853 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac1f19-2031-4eb6-a583-1ad387ad3126 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:27.367992 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a3159-2776-42b0-a5c4-9251b2d5165c None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:27.386042 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:27.443320 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4b19b7-fb78-4d5c-a36b-683a78d719fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:27.444364 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b19b7-fb78-4d5c-a36b-683a78d719fe None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:27.445083 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b19b7-fb78-4d5c-a36b-683a78d719fe None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:27.445642 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b19b7-fb78-4d5c-a36b-683a78d719fe None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:27.446726 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4b19b7-fb78-4d5c-a36b-683a78d719fe None admin] RBAC: Adding query filter params (name=member) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:42:27.447265 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4b19b7-fb78-4d5c-a36b-683a78d719fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:27.449925 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4b19b7-fb78-4d5c-a36b-683a78d719fe None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:27.470181 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 136/281] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Sep 18 00:42:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:42:27.472123 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4b19b7-fb78-4d5c-a36b-683a78d719fe None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:27.496629 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:27.545041 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac1f19-2031-4eb6-a583-1ad387ad3126 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:27.619706 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e7d632-4fff-4100-8655-e9dd5a537f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:27.622816 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e7d632-4fff-4100-8655-e9dd5a537f6f None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:27.623526 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e7d632-4fff-4100-8655-e9dd5a537f6f None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:27.624245 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e7d632-4fff-4100-8655-e9dd5a537f6f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:27.646204 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e7d632-4fff-4100-8655-e9dd5a537f6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:42:27.662257 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-41e7d632-4fff-4100-8655-e9dd5a537f6f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 18 00:42:27.662257 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:42:27.662257 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:42:27.662257 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:42:27.662257 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:42:27.662257 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:42:27.662257 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:42:27.662257 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:42:27.662257 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:42:27.662257 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:42:27.662257 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:42:27.662257 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:42:27.662257 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:42:27.662257 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:42:27.662257 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:42:27.662257 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:42:27.664324 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:42:27.664324 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:42:27.664324 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:42:27.664324 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:42:27.664324 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:42:27.664324 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:42:27.664324 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:42:27.664324 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:42:27.664324 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:42:27.664324 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:42:27.664324 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:42:27.664324 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:42:27.664324 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:42:27.664324 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:42:27.664324 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:42:27.664324 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:42:27.666198 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:42:27.666198 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:42:27.666198 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:42:27.666198 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:42:27.666198 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:42:27.666198 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:42:27.666198 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:42:27.666198 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:42:27.666198 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:42:27.666198 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:42:27.666198 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 18 00:42:27.666198 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:42:27.670791 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 146/282] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Sep 18 00:42:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:42:27.672761 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e7d632-4fff-4100-8655-e9dd5a537f6f None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:27.696610 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4b19b7-fb78-4d5c-a36b-683a78d719fe None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:27.759924 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc1b7b2-e39e-4cea-9948-ca2726fabb97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:27.760635 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1b7b2-e39e-4cea-9948-ca2726fabb97 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:27.760923 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1b7b2-e39e-4cea-9948-ca2726fabb97 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:27.761199 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1b7b2-e39e-4cea-9948-ca2726fabb97 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:27.773029 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc1b7b2-e39e-4cea-9948-ca2726fabb97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:42:27.778581 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-4dc1b7b2-e39e-4cea-9948-ca2726fabb97 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 18 00:42:27.778581 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:42:27.778581 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:42:27.778581 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:42:27.778581 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:42:27.778581 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:42:27.778581 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:42:27.778581 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:42:27.778581 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:42:27.778581 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:42:27.778581 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:42:27.778581 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:42:27.778581 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:42:27.778581 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:42:27.778581 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:42:27.778581 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:42:27.780260 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:42:27.780260 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:42:27.780260 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:42:27.780260 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:42:27.780260 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:42:27.780260 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:42:27.780260 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:42:27.780260 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:42:27.780260 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:42:27.780260 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:42:27.780260 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:42:27.780260 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:42:27.780260 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:42:27.780260 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:42:27.780260 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:42:27.780260 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:42:27.781754 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:42:27.781754 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:42:27.781754 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:42:27.781754 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:42:27.781754 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:42:27.781754 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:42:27.781754 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:42:27.781754 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:42:27.781754 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:42:27.781754 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:42:27.781754 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 18 00:42:27.781754 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:42:27.781754 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 137/283] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Sep 18 00:42:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:42:27.781754 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc1b7b2-e39e-4cea-9948-ca2726fabb97 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:27.846081 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:27.859685 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:27.892728 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e7d632-4fff-4100-8655-e9dd5a537f6f None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:27.894385 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc1b7b2-e39e-4cea-9948-ca2726fabb97 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:27.933158 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac1c0c8-2451-4152-830f-48e04464839f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:27.933823 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1c0c8-2451-4152-830f-48e04464839f None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:27.934158 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1c0c8-2451-4152-830f-48e04464839f None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:27.934455 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1c0c8-2451-4152-830f-48e04464839f None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:27.935149 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac1c0c8-2451-4152-830f-48e04464839f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:42:27.935459 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac1c0c8-2451-4152-830f-48e04464839f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:27.936907 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac1c0c8-2451-4152-830f-48e04464839f None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:27.946891 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 138/284] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Sep 18 00:42:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:27.947516 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac1c0c8-2451-4152-830f-48e04464839f None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:27.966920 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5835b1a6-3de2-464a-999a-a62b3e414946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:27.968796 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835b1a6-3de2-464a-999a-a62b3e414946 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:27.969587 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835b1a6-3de2-464a-999a-a62b3e414946 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:27.970353 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835b1a6-3de2-464a-999a-a62b3e414946 None admin] PATH_INFO: `/v3/users/55a2ad1b7dae4bea9043e6da152eb800` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:27.998540 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5835b1a6-3de2-464a-999a-a62b3e414946 None admin] RBAC: Authorizing `identity:get_user(user_id=55a2ad1b7dae4bea9043e6da152eb800)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:28.001930 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5835b1a6-3de2-464a-999a-a62b3e414946 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:28.006155 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 147/285] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Sep 18 00:42:27 2022] GET /identity/v3/users/55a2ad1b7dae4bea9043e6da152eb800 => generated 293 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:28.007791 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5835b1a6-3de2-464a-999a-a62b3e414946 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:28.060662 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac1c0c8-2451-4152-830f-48e04464839f None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:28.095792 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:28.102135 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd2befc-7da1-4589-beff-50143e937344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:28.102819 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd2befc-7da1-4589-beff-50143e937344 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:28.103110 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd2befc-7da1-4589-beff-50143e937344 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:28.103412 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd2befc-7da1-4589-beff-50143e937344 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:28.104168 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd2befc-7da1-4589-beff-50143e937344 None admin] RBAC: Adding query filter params (name=member) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:42:28.104483 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd2befc-7da1-4589-beff-50143e937344 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:28.106001 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd2befc-7da1-4589-beff-50143e937344 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:28.116628 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 139/286] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Sep 18 00:42:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:28.117521 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd2befc-7da1-4589-beff-50143e937344 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:28.212659 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5835b1a6-3de2-464a-999a-a62b3e414946 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:28.238276 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd2befc-7da1-4589-beff-50143e937344 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:28.287813 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac83aaad-08c0-4c50-ab06-371874c6cfdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:28.288550 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83aaad-08c0-4c50-ab06-371874c6cfdc None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:28.288832 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83aaad-08c0-4c50-ab06-371874c6cfdc None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:28.289104 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83aaad-08c0-4c50-ab06-371874c6cfdc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:28.289847 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac83aaad-08c0-4c50-ab06-371874c6cfdc None admin] RBAC: Adding query filter params (role.id=59d7218a321b4c20bc1996494a48a2a1, user.id=55a2ad1b7dae4bea9043e6da152eb800, scope.system=all) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:42:28.290158 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac83aaad-08c0-4c50-ab06-371874c6cfdc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:28.291932 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac83aaad-08c0-4c50-ab06-371874c6cfdc None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:28.298477 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 140/287] 10.222.0.15 () {56 vars in 1308 bytes} [Sun Sep 18 00:42:28 2022] GET /identity/v3/role_assignments?user.id=55a2ad1b7dae4bea9043e6da152eb800&scope.system=all&role.id=59d7218a321b4c20bc1996494a48a2a1 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:28.299365 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac83aaad-08c0-4c50-ab06-371874c6cfdc None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:28.304665 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c6981-af4f-4208-a69f-57087fd03140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:28.305358 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c6981-af4f-4208-a69f-57087fd03140 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:28.305641 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c6981-af4f-4208-a69f-57087fd03140 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:28.305920 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c6981-af4f-4208-a69f-57087fd03140 None admin] PATH_INFO: `/v3/users/bd6d825724194faa88ac5fb5e54f7500` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:28.308564 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2c6981-af4f-4208-a69f-57087fd03140 None admin] RBAC: Authorizing `identity:get_user(user_id=bd6d825724194faa88ac5fb5e54f7500)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:28.310145 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2c6981-af4f-4208-a69f-57087fd03140 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:28.318185 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 148/288] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Sep 18 00:42:28 2022] GET /identity/v3/users/bd6d825724194faa88ac5fb5e54f7500 => generated 297 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:28.321941 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c6981-af4f-4208-a69f-57087fd03140 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:28.343565 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:28.443969 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:28.591022 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac83aaad-08c0-4c50-ab06-371874c6cfdc None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:28.602260 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c6981-af4f-4208-a69f-57087fd03140 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:28.636712 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77edb700-803c-4b9f-8535-4933f4fd2ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:28.637717 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77edb700-803c-4b9f-8535-4933f4fd2ebc None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:28.638226 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77edb700-803c-4b9f-8535-4933f4fd2ebc None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:28.638699 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77edb700-803c-4b9f-8535-4933f4fd2ebc None admin] PATH_INFO: `/v3/users/3f62ac376ca84b38b71691623699f6d8` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:28.640189 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77edb700-803c-4b9f-8535-4933f4fd2ebc None admin] RBAC: Authorizing `identity:get_user(user_id=3f62ac376ca84b38b71691623699f6d8)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:28.641905 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77edb700-803c-4b9f-8535-4933f4fd2ebc None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:28.643927 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 141/289] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Sep 18 00:42:28 2022] GET /identity/v3/users/3f62ac376ca84b38b71691623699f6d8 => generated 297 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:28.657099 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77edb700-803c-4b9f-8535-4933f4fd2ebc None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:28.690174 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db2c080-3c86-488b-a7bf-817f0b2e3e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:28.691187 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2c080-3c86-488b-a7bf-817f0b2e3e4d None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:28.691623 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2c080-3c86-488b-a7bf-817f0b2e3e4d None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:28.692082 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2c080-3c86-488b-a7bf-817f0b2e3e4d None admin] PATH_INFO: `/v3/projects/14cc5534b3054dfbbc19e546f4d51538` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:28.695014 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db2c080-3c86-488b-a7bf-817f0b2e3e4d None admin] RBAC: Authorizing `identity:get_project(project_id=14cc5534b3054dfbbc19e546f4d51538)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:28.697879 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db2c080-3c86-488b-a7bf-817f0b2e3e4d None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:28.701342 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 149/290] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Sep 18 00:42:28 2022] GET /identity/v3/projects/14cc5534b3054dfbbc19e546f4d51538 => generated 302 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:28.709644 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db2c080-3c86-488b-a7bf-817f0b2e3e4d None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:28.961600 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77edb700-803c-4b9f-8535-4933f4fd2ebc None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:28.996427 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:29.043352 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:29.056281 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db2c080-3c86-488b-a7bf-817f0b2e3e4d None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:29.077261 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc16a0d-d8bf-47e1-b735-e7e99bbb49a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:29.077895 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc16a0d-d8bf-47e1-b735-e7e99bbb49a2 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:29.078189 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc16a0d-d8bf-47e1-b735-e7e99bbb49a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:29.078462 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc16a0d-d8bf-47e1-b735-e7e99bbb49a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:29.171652 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b7599-bb5f-4645-8893-b9012929a43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:29.173533 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b7599-bb5f-4645-8893-b9012929a43b None admin] REQUEST_METHOD: `PUT` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:29.178664 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b7599-bb5f-4645-8893-b9012929a43b None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:29.179576 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b7599-bb5f-4645-8893-b9012929a43b None admin] PATH_INFO: `/v3/projects/14cc5534b3054dfbbc19e546f4d51538/users/bd6d825724194faa88ac5fb5e54f7500/roles/21a002d535ce432597d9291135265677` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:29.185300 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166b7599-bb5f-4645-8893-b9012929a43b None admin] RBAC: Authorizing `identity:create_grant(project_id=14cc5534b3054dfbbc19e546f4d51538, user_id=bd6d825724194faa88ac5fb5e54f7500, role_id=21a002d535ce432597d9291135265677)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:29.188477 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166b7599-bb5f-4645-8893-b9012929a43b None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:29.222105 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 150/291] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Sep 18 00:42:28 2022] PUT /identity/v3/projects/14cc5534b3054dfbbc19e546f4d51538/users/bd6d825724194faa88ac5fb5e54f7500/roles/21a002d535ce432597d9291135265677 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 00:42:29.290848 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc16a0d-d8bf-47e1-b735-e7e99bbb49a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:29.293911 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc16a0d-d8bf-47e1-b735-e7e99bbb49a2 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:29.541072 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 142/292] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Sep 18 00:42:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 884 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 00:42:29.549982 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b7599-bb5f-4645-8893-b9012929a43b None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:29.760371 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b7599-bb5f-4645-8893-b9012929a43b None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:29.830334 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019711ed-df69-47cb-8d3c-ce354df11dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:29.831913 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019711ed-df69-47cb-8d3c-ce354df11dd3 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:29.832701 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019711ed-df69-47cb-8d3c-ce354df11dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:29.833946 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019711ed-df69-47cb-8d3c-ce354df11dd3 None admin] PATH_INFO: `/v3/projects/14cc5534b3054dfbbc19e546f4d51538` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:29.836386 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019711ed-df69-47cb-8d3c-ce354df11dd3 None admin] RBAC: Authorizing `identity:get_project(project_id=14cc5534b3054dfbbc19e546f4d51538)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:29.839590 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019711ed-df69-47cb-8d3c-ce354df11dd3 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:29.843512 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 151/293] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Sep 18 00:42:29 2022] GET /identity/v3/projects/14cc5534b3054dfbbc19e546f4d51538 => generated 302 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:29.854154 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc16a0d-d8bf-47e1-b735-e7e99bbb49a2 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:29.932609 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:30.109073 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc16a0d-d8bf-47e1-b735-e7e99bbb49a2 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:30.177001 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd16464-ec4e-4424-be5e-969947b3c76f None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:30.177289 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd16464-ec4e-4424-be5e-969947b3c76f None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:30.177620 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd16464-ec4e-4424-be5e-969947b3c76f None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:30.179248 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 152/294] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:42:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:42:30.185023 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1dc19b-bf71-4199-88e6-d295025b40fe None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:30.185399 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1dc19b-bf71-4199-88e6-d295025b40fe None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:30.185575 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1dc19b-bf71-4199-88e6-d295025b40fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:30.201823 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:30.204079 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a780fca-f90b-47d1-b589-98754e187608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:30.204735 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a780fca-f90b-47d1-b589-98754e187608 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:30.205018 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a780fca-f90b-47d1-b589-98754e187608 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:30.205325 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a780fca-f90b-47d1-b589-98754e187608 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:30.206650 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a780fca-f90b-47d1-b589-98754e187608 None admin] RBAC: Adding query filter params (role.id=59d7218a321b4c20bc1996494a48a2a1, scope.project.id=14cc5534b3054dfbbc19e546f4d51538, user.id=3f62ac376ca84b38b71691623699f6d8) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:42:30.206650 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a780fca-f90b-47d1-b589-98754e187608 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:30.208093 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a780fca-f90b-47d1-b589-98754e187608 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:30.215069 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-fc1dc19b-bf71-4199-88e6-d295025b40fe None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:42:30.217836 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-fc1dc19b-bf71-4199-88e6-d295025b40fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:42:30.228485 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 143/295] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Sep 18 00:42:29 2022] GET /identity/v3/role_assignments?user.id=3f62ac376ca84b38b71691623699f6d8&scope.project.id=14cc5534b3054dfbbc19e546f4d51538&role.id=59d7218a321b4c20bc1996494a48a2a1 => generated 608 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:30.378794 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 153/296] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:42:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 18 00:42:30.947122 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05d52a-43d9-4b74-a911-405e691e21bd None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:30.948173 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05d52a-43d9-4b74-a911-405e691e21bd None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:30.948977 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05d52a-43d9-4b74-a911-405e691e21bd None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:30.952735 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 144/297] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:42:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:42:30.957388 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1dc19b-bf71-4199-88e6-d295025b40fe None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:30.963773 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5fec4f-b7eb-4194-b2ee-41677c1decd4 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:30.964606 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5fec4f-b7eb-4194-b2ee-41677c1decd4 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:30.965401 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5fec4f-b7eb-4194-b2ee-41677c1decd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:30.992655 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-6c5fec4f-b7eb-4194-b2ee-41677c1decd4 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:42:30.993891 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-6c5fec4f-b7eb-4194-b2ee-41677c1decd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:42:31.105857 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1dc19b-bf71-4199-88e6-d295025b40fe None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:31.127379 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 145/298] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:42:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 00:42:31.172899 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:31.183049 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a66d6c-52a5-40f8-8165-2839c94ad882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:31.184139 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a66d6c-52a5-40f8-8165-2839c94ad882 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:31.184598 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a66d6c-52a5-40f8-8165-2839c94ad882 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:31.185069 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a66d6c-52a5-40f8-8165-2839c94ad882 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:31.187214 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a66d6c-52a5-40f8-8165-2839c94ad882 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:31.190019 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a66d6c-52a5-40f8-8165-2839c94ad882 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:31.193603 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 154/299] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:42:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:31.201880 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5fec4f-b7eb-4194-b2ee-41677c1decd4 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:31.233146 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:31.328024 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5fec4f-b7eb-4194-b2ee-41677c1decd4 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:31.386442 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df002241-168e-477d-a567-2a2f4c978126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:31.387472 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df002241-168e-477d-a567-2a2f4c978126 None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:31.388003 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df002241-168e-477d-a567-2a2f4c978126 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:31.388496 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df002241-168e-477d-a567-2a2f4c978126 None admin] PATH_INFO: `/v3/groups` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:31.389677 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df002241-168e-477d-a567-2a2f4c978126 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:31.392462 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df002241-168e-477d-a567-2a2f4c978126 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:31.425843 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 146/300] 10.222.0.15 () {60 vars in 1134 bytes} [Sun Sep 18 00:42:31 2022] POST /identity/v3/groups => generated 229 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 00:42:31.486950 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a66d6c-52a5-40f8-8165-2839c94ad882 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:31.662420 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a66d6c-52a5-40f8-8165-2839c94ad882 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:31.703666 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e6578-e358-4ead-8ae4-57a700b7d9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:31.704353 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e6578-e358-4ead-8ae4-57a700b7d9fe None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:31.704686 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e6578-e358-4ead-8ae4-57a700b7d9fe None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:31.704965 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e6578-e358-4ead-8ae4-57a700b7d9fe None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:31.718435 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6e6578-e358-4ead-8ae4-57a700b7d9fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:42:31.723063 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-2d6e6578-e358-4ead-8ae4-57a700b7d9fe None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 18 00:42:31.723063 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:42:31.723063 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:42:31.723063 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:42:31.723063 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:42:31.723063 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:42:31.723063 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:42:31.723063 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:42:31.723063 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:42:31.723063 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:42:31.723063 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:42:31.723063 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:42:31.723063 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:42:31.723063 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:42:31.723063 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:42:31.723063 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:42:31.725301 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:42:31.725301 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:42:31.725301 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:42:31.725301 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:42:31.725301 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:42:31.725301 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:42:31.725301 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:42:31.725301 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:42:31.725301 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:42:31.725301 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:42:31.725301 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:42:31.725301 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:42:31.725301 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:42:31.725301 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:42:31.725301 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:42:31.725301 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:42:31.726827 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:42:31.726827 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:42:31.726827 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:42:31.726827 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:42:31.726827 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:42:31.726827 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:42:31.726827 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:42:31.726827 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:42:31.726827 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:42:31.726827 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:42:31.726827 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 18 00:42:31.726827 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:42:31.726827 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 155/301] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Sep 18 00:42:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:42:31.734847 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df002241-168e-477d-a567-2a2f4c978126 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:31.916492 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:31.964900 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df002241-168e-477d-a567-2a2f4c978126 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:32.029652 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8210d1f-23ed-4d64-8063-098e63cc18d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:32.031431 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8210d1f-23ed-4d64-8063-098e63cc18d1 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:32.032224 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8210d1f-23ed-4d64-8063-098e63cc18d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:32.032947 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8210d1f-23ed-4d64-8063-098e63cc18d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:32.034443 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8210d1f-23ed-4d64-8063-098e63cc18d1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:42:32.035241 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8210d1f-23ed-4d64-8063-098e63cc18d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:32.038366 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8210d1f-23ed-4d64-8063-098e63cc18d1 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:32.064127 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 147/302] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Sep 18 00:42:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:32.067281 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e6578-e358-4ead-8ae4-57a700b7d9fe None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:32.173483 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:32.246890 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e6578-e358-4ead-8ae4-57a700b7d9fe None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:32.289367 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964be067-2305-41d4-877e-f05c8ba279b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:32.289962 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964be067-2305-41d4-877e-f05c8ba279b2 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:32.290249 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964be067-2305-41d4-877e-f05c8ba279b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:32.290533 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964be067-2305-41d4-877e-f05c8ba279b2 None admin] PATH_INFO: `/v3/users/d50c16d6115048cc8233833439a351a6` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:32.307767 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964be067-2305-41d4-877e-f05c8ba279b2 None admin] RBAC: Authorizing `identity:get_user(user_id=d50c16d6115048cc8233833439a351a6)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:32.309368 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964be067-2305-41d4-877e-f05c8ba279b2 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:32.311613 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 156/303] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Sep 18 00:42:32 2022] GET /identity/v3/users/d50c16d6115048cc8233833439a351a6 => generated 293 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:32.318701 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8210d1f-23ed-4d64-8063-098e63cc18d1 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:32.435438 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d17b9b-3480-44f5-ba86-38e8985cf806 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:32.435939 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d17b9b-3480-44f5-ba86-38e8985cf806 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:32.436401 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d17b9b-3480-44f5-ba86-38e8985cf806 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:32.439166 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 157/304] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:42:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:42:32.449282 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a016a8-98ef-4363-b30c-78e076ed93e8 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:32.449888 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a016a8-98ef-4363-b30c-78e076ed93e8 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:32.450350 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a016a8-98ef-4363-b30c-78e076ed93e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:32.486961 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-79a016a8-98ef-4363-b30c-78e076ed93e8 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:42:32.489845 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-79a016a8-98ef-4363-b30c-78e076ed93e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:42:32.529780 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8210d1f-23ed-4d64-8063-098e63cc18d1 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:32.594587 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c353b0f-124a-4227-bfe6-bcf168f2b4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:32.595874 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c353b0f-124a-4227-bfe6-bcf168f2b4ad None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:32.596594 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c353b0f-124a-4227-bfe6-bcf168f2b4ad None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:32.597343 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c353b0f-124a-4227-bfe6-bcf168f2b4ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:32.601680 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c353b0f-124a-4227-bfe6-bcf168f2b4ad None admin] RBAC: Adding query filter params (role.id=21a002d535ce432597d9291135265677, user.id=d50c16d6115048cc8233833439a351a6, scope.system=all) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:42:32.601680 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c353b0f-124a-4227-bfe6-bcf168f2b4ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:32.602094 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c353b0f-124a-4227-bfe6-bcf168f2b4ad None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:32.611756 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 148/305] 10.222.0.15 () {56 vars in 1308 bytes} [Sun Sep 18 00:42:32 2022] GET /identity/v3/role_assignments?user.id=d50c16d6115048cc8233833439a351a6&scope.system=all&role.id=21a002d535ce432597d9291135265677 => generated 226 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:32.633479 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 158/306] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:42:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 00:42:32.785628 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e143c9c-3a26-41be-8764-81dd1fc19d7a None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:32.786393 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e143c9c-3a26-41be-8764-81dd1fc19d7a None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:32.786943 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e143c9c-3a26-41be-8764-81dd1fc19d7a None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:32.789662 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 149/307] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:42:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:42:32.795790 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11aaac-bca8-4872-a715-d7bc078df77e None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:32.796119 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11aaac-bca8-4872-a715-d7bc078df77e None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:32.796392 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11aaac-bca8-4872-a715-d7bc078df77e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:32.817313 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-7f11aaac-bca8-4872-a715-d7bc078df77e None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:42:32.818527 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-7f11aaac-bca8-4872-a715-d7bc078df77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:42:32.875625 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:32.907998 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 159/308] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:42:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 00:42:33.127711 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e143c9c-3a26-41be-8764-81dd1fc19d7a None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:33.144567 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:33.179603 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f11aaac-bca8-4872-a715-d7bc078df77e None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:33.335497 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e143c9c-3a26-41be-8764-81dd1fc19d7a None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:33.365197 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f11aaac-bca8-4872-a715-d7bc078df77e None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:33.401378 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef32bd13-28c1-48bf-b777-79675baf0204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:33.402038 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef32bd13-28c1-48bf-b777-79675baf0204 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:33.402307 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef32bd13-28c1-48bf-b777-79675baf0204 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:33.402585 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef32bd13-28c1-48bf-b777-79675baf0204 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:33.422572 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef32bd13-28c1-48bf-b777-79675baf0204 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:42:33.431044 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f61069-f5d6-4a60-a6e8-d9d3574c4652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:33.431684 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f61069-f5d6-4a60-a6e8-d9d3574c4652 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:33.431985 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f61069-f5d6-4a60-a6e8-d9d3574c4652 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:33.432243 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f61069-f5d6-4a60-a6e8-d9d3574c4652 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:33.434488 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-ef32bd13-28c1-48bf-b777-79675baf0204 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 18 00:42:33.434488 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:42:33.434488 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:42:33.434488 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:42:33.434488 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:42:33.434488 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:42:33.434488 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:42:33.434488 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:42:33.434488 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:42:33.434488 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:42:33.434488 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:42:33.434488 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:42:33.434488 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:42:33.434488 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:42:33.434488 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:42:33.434488 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:42:33.436621 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:42:33.436621 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:42:33.436621 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:42:33.436621 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:42:33.436621 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:42:33.436621 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:42:33.436621 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:42:33.436621 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:42:33.436621 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:42:33.436621 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:42:33.436621 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:42:33.436621 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:42:33.436621 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:42:33.436621 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:42:33.436621 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:42:33.436621 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:42:33.438312 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:42:33.438312 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:42:33.438312 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:42:33.438312 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:42:33.438312 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:42:33.438312 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:42:33.438312 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:42:33.438312 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:42:33.438312 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:42:33.438312 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:42:33.438312 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 18 00:42:33.438312 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:42:33.442525 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 150/309] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Sep 18 00:42:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 00:42:33.445226 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f61069-f5d6-4a60-a6e8-d9d3574c4652 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:42:33.455678 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef32bd13-28c1-48bf-b777-79675baf0204 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:33.460723 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-a3f61069-f5d6-4a60-a6e8-d9d3574c4652 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 18 00:42:33.460723 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:42:33.460723 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:42:33.460723 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:42:33.460723 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:42:33.460723 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:42:33.460723 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:42:33.460723 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:42:33.460723 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:42:33.460723 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:42:33.460723 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:42:33.460723 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:42:33.460723 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:42:33.460723 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:42:33.460723 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:42:33.460723 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:42:33.462513 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:42:33.462513 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:42:33.462513 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:42:33.462513 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:42:33.462513 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:42:33.462513 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:42:33.462513 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:42:33.462513 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:42:33.462513 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:42:33.462513 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:42:33.462513 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:42:33.462513 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:42:33.462513 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:42:33.462513 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:42:33.462513 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:42:33.462513 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:42:33.464921 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:42:33.464921 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:42:33.464921 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:42:33.464921 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:42:33.464921 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:42:33.464921 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:42:33.464921 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:42:33.464921 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:42:33.464921 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:42:33.464921 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:42:33.464921 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 18 00:42:33.464921 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:42:33.464921 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 160/310] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Sep 18 00:42:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 00:42:33.472755 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f61069-f5d6-4a60-a6e8-d9d3574c4652 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:33.559306 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:33.609104 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:33.665051 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef32bd13-28c1-48bf-b777-79675baf0204 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:33.669935 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f61069-f5d6-4a60-a6e8-d9d3574c4652 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:33.711442 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a56c713-c0de-4d57-85d1-4cefcb15fa02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:33.712135 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56c713-c0de-4d57-85d1-4cefcb15fa02 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:33.712416 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56c713-c0de-4d57-85d1-4cefcb15fa02 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:33.712691 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56c713-c0de-4d57-85d1-4cefcb15fa02 None admin] PATH_INFO: `/v3/roles` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:33.713526 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a56c713-c0de-4d57-85d1-4cefcb15fa02 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:42:33.713836 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a56c713-c0de-4d57-85d1-4cefcb15fa02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:33.715323 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a56c713-c0de-4d57-85d1-4cefcb15fa02 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:33.724153 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1afed9-0c50-4d99-b32e-e15b41fe3b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:33.725170 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1afed9-0c50-4d99-b32e-e15b41fe3b0d None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:33.725684 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1afed9-0c50-4d99-b32e-e15b41fe3b0d None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:33.726159 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1afed9-0c50-4d99-b32e-e15b41fe3b0d None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:33.727051 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1afed9-0c50-4d99-b32e-e15b41fe3b0d None admin] RBAC: Adding query filter params (name=member) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:42:33.727575 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1afed9-0c50-4d99-b32e-e15b41fe3b0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:33.729249 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1afed9-0c50-4d99-b32e-e15b41fe3b0d None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:33.731814 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 161/311] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Sep 18 00:42:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:33.732961 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a56c713-c0de-4d57-85d1-4cefcb15fa02 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:33.740310 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 151/312] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Sep 18 00:42:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:33.746027 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1afed9-0c50-4d99-b32e-e15b41fe3b0d None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:33.862462 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:33.866532 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a56c713-c0de-4d57-85d1-4cefcb15fa02 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:33.870174 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1afed9-0c50-4d99-b32e-e15b41fe3b0d None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:33.902913 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:33.913091 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77029bdc-d987-4459-8a8b-1571ea63aab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:33.913926 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5964ca12-91fb-4bd6-a816-46485f3c747d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:33.914261 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77029bdc-d987-4459-8a8b-1571ea63aab1 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:33.914708 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77029bdc-d987-4459-8a8b-1571ea63aab1 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:33.914826 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964ca12-91fb-4bd6-a816-46485f3c747d None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:33.915182 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964ca12-91fb-4bd6-a816-46485f3c747d None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:33.915423 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77029bdc-d987-4459-8a8b-1571ea63aab1 None admin] PATH_INFO: `/v3/users/55a2ad1b7dae4bea9043e6da152eb800` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:33.915534 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964ca12-91fb-4bd6-a816-46485f3c747d None admin] PATH_INFO: `/v3/users/bd6d825724194faa88ac5fb5e54f7500` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:33.917208 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77029bdc-d987-4459-8a8b-1571ea63aab1 None admin] RBAC: Authorizing `identity:get_user(user_id=55a2ad1b7dae4bea9043e6da152eb800)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:33.917355 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5964ca12-91fb-4bd6-a816-46485f3c747d None admin] RBAC: Authorizing `identity:get_user(user_id=bd6d825724194faa88ac5fb5e54f7500)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:33.918846 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5964ca12-91fb-4bd6-a816-46485f3c747d None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:33.919130 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77029bdc-d987-4459-8a8b-1571ea63aab1 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:33.920736 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 162/313] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Sep 18 00:42:33 2022] GET /identity/v3/users/bd6d825724194faa88ac5fb5e54f7500 => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:33.926001 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 152/314] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Sep 18 00:42:33 2022] GET /identity/v3/users/55a2ad1b7dae4bea9043e6da152eb800 => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:33.927114 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5964ca12-91fb-4bd6-a816-46485f3c747d None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:33.927421 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77029bdc-d987-4459-8a8b-1571ea63aab1 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:34.074533 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77029bdc-d987-4459-8a8b-1571ea63aab1 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:34.121395 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5964ca12-91fb-4bd6-a816-46485f3c747d None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:34.125313 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd04e6d-3caf-466c-b5a7-d6d02ea877d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:34.126385 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd04e6d-3caf-466c-b5a7-d6d02ea877d9 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:34.126914 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd04e6d-3caf-466c-b5a7-d6d02ea877d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:34.127413 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd04e6d-3caf-466c-b5a7-d6d02ea877d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:34.196513 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a2be8-9db2-4770-bd19-5e19b5ee6d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:34.197950 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a2be8-9db2-4770-bd19-5e19b5ee6d9a None admin] REQUEST_METHOD: `PUT` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:34.198456 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a2be8-9db2-4770-bd19-5e19b5ee6d9a None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:34.198936 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a2be8-9db2-4770-bd19-5e19b5ee6d9a None admin] PATH_INFO: `/v3/system/users/55a2ad1b7dae4bea9043e6da152eb800/roles/59d7218a321b4c20bc1996494a48a2a1` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:34.200844 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002a2be8-9db2-4770-bd19-5e19b5ee6d9a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=55a2ad1b7dae4bea9043e6da152eb800, role_id=59d7218a321b4c20bc1996494a48a2a1)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:34.202537 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002a2be8-9db2-4770-bd19-5e19b5ee6d9a None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:34.216059 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 163/315] 10.222.0.15 () {58 vars in 1334 bytes} [Sun Sep 18 00:42:33 2022] PUT /identity/v3/system/users/55a2ad1b7dae4bea9043e6da152eb800/roles/59d7218a321b4c20bc1996494a48a2a1 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 00:42:34.228001 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d36d0e4-1bf8-4678-853e-1bd8a09bbf02 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:34.228339 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d36d0e4-1bf8-4678-853e-1bd8a09bbf02 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:34.228561 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d36d0e4-1bf8-4678-853e-1bd8a09bbf02 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:34.230271 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 164/316] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:42:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 18 00:42:34.232457 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:34.236108 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9e39a-5278-4d44-bcf6-182d2834189e None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:34.237331 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9e39a-5278-4d44-bcf6-182d2834189e None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:34.237619 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9e39a-5278-4d44-bcf6-182d2834189e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:34.241603 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd04e6d-3caf-466c-b5a7-d6d02ea877d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:34.243238 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd04e6d-3caf-466c-b5a7-d6d02ea877d9 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:34.260902 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-84a9e39a-5278-4d44-bcf6-182d2834189e None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:42:34.262348 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-84a9e39a-5278-4d44-bcf6-182d2834189e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:42:34.305019 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:34.379779 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 165/317] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:42:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 18 00:42:34.403623 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 153/318] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Sep 18 00:42:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 00:42:34.409672 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a9e39a-5278-4d44-bcf6-182d2834189e None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:34.533336 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a9e39a-5278-4d44-bcf6-182d2834189e None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:34.575796 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9404d993-a148-40de-990c-7a768912ccfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:34.576482 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404d993-a148-40de-990c-7a768912ccfe None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:34.576758 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404d993-a148-40de-990c-7a768912ccfe None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:34.577028 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404d993-a148-40de-990c-7a768912ccfe None admin] PATH_INFO: `/v3/projects/14cc5534b3054dfbbc19e546f4d51538` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:34.578254 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9404d993-a148-40de-990c-7a768912ccfe None admin] RBAC: Authorizing `identity:get_project(project_id=14cc5534b3054dfbbc19e546f4d51538)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:34.579807 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9404d993-a148-40de-990c-7a768912ccfe None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:34.585984 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 166/319] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Sep 18 00:42:34 2022] GET /identity/v3/projects/14cc5534b3054dfbbc19e546f4d51538 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:42:34.588278 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd04e6d-3caf-466c-b5a7-d6d02ea877d9 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:34.700796 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:34.704559 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9404d993-a148-40de-990c-7a768912ccfe None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:34.708040 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd04e6d-3caf-466c-b5a7-d6d02ea877d9 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:34.748972 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:34.749146 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77608bdb-9041-4792-ba20-1d4090f0e655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:34.749524 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77608bdb-9041-4792-ba20-1d4090f0e655 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:34.749837 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77608bdb-9041-4792-ba20-1d4090f0e655 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:34.750116 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77608bdb-9041-4792-ba20-1d4090f0e655 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:34.750899 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77608bdb-9041-4792-ba20-1d4090f0e655 None admin] RBAC: Adding query filter params (role.id=21a002d535ce432597d9291135265677, scope.project.id=14cc5534b3054dfbbc19e546f4d51538, user.id=bd6d825724194faa88ac5fb5e54f7500) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:42:34.751298 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77608bdb-9041-4792-ba20-1d4090f0e655 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:34.753048 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77608bdb-9041-4792-ba20-1d4090f0e655 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:34.763958 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 154/320] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Sep 18 00:42:34 2022] GET /identity/v3/role_assignments?user.id=bd6d825724194faa88ac5fb5e54f7500&scope.project.id=14cc5534b3054dfbbc19e546f4d51538&role.id=21a002d535ce432597d9291135265677 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:34.877505 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9404d993-a148-40de-990c-7a768912ccfe None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:34.962193 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a52ff-bdf4-4b38-b5ab-e396b215c123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:34.963380 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a52ff-bdf4-4b38-b5ab-e396b215c123 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:34.963878 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a52ff-bdf4-4b38-b5ab-e396b215c123 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:34.964409 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a52ff-bdf4-4b38-b5ab-e396b215c123 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:34.966704 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64a52ff-bdf4-4b38-b5ab-e396b215c123 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:34.969608 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64a52ff-bdf4-4b38-b5ab-e396b215c123 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:34.972891 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 167/321] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:42:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:34.980660 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77608bdb-9041-4792-ba20-1d4090f0e655 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:35.076008 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2e60a-1676-4f80-94ab-0d6293792134 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:35.076008 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2e60a-1676-4f80-94ab-0d6293792134 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:35.076008 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2e60a-1676-4f80-94ab-0d6293792134 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:35.076748 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 168/322] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:42:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:42:35.086193 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43196a1b-9b63-49f1-a3c1-1f70046da7a9 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:35.086640 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43196a1b-9b63-49f1-a3c1-1f70046da7a9 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:35.087078 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43196a1b-9b63-49f1-a3c1-1f70046da7a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:35.123600 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-43196a1b-9b63-49f1-a3c1-1f70046da7a9 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:42:35.125144 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-43196a1b-9b63-49f1-a3c1-1f70046da7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:42:35.134960 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77608bdb-9041-4792-ba20-1d4090f0e655 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:35.184434 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2941568e-1a20-4c15-95b7-bb673edba8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:35.185398 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2941568e-1a20-4c15-95b7-bb673edba8c5 None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:35.185865 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2941568e-1a20-4c15-95b7-bb673edba8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:35.186326 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2941568e-1a20-4c15-95b7-bb673edba8c5 None admin] PATH_INFO: `/v3/groups` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:35.188062 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2941568e-1a20-4c15-95b7-bb673edba8c5 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:35.190631 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2941568e-1a20-4c15-95b7-bb673edba8c5 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:35.219941 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 155/323] 10.222.0.15 () {60 vars in 1134 bytes} [Sun Sep 18 00:42:34 2022] POST /identity/v3/groups => generated 226 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 00:42:35.234875 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 169/324] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:42:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 00:42:35.545487 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2941568e-1a20-4c15-95b7-bb673edba8c5 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:35.571723 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:35.662070 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2941568e-1a20-4c15-95b7-bb673edba8c5 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:35.700013 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8e333e-06bb-4943-a393-a53eb9deacec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:35.700668 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e333e-06bb-4943-a393-a53eb9deacec None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:35.700951 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e333e-06bb-4943-a393-a53eb9deacec None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:35.701226 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e333e-06bb-4943-a393-a53eb9deacec None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:35.713827 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8e333e-06bb-4943-a393-a53eb9deacec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:42:35.719323 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-2f8e333e-06bb-4943-a393-a53eb9deacec None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 18 00:42:35.719323 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:42:35.719323 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:42:35.719323 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:42:35.719323 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:42:35.719323 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:42:35.719323 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:42:35.719323 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:42:35.719323 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:42:35.719323 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:42:35.719323 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:42:35.719323 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:42:35.719323 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:42:35.719323 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:42:35.719323 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:42:35.719323 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:42:35.720302 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:42:35.720302 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:42:35.720302 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:42:35.720302 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:42:35.720302 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:42:35.720302 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:42:35.720302 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:42:35.720302 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:42:35.720302 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:42:35.720302 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:42:35.720302 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:42:35.720302 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:42:35.720302 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:42:35.720302 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:42:35.720302 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:42:35.720302 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:42:35.721080 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:42:35.721080 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:42:35.721080 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:42:35.721080 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:42:35.721080 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:42:35.721080 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:42:35.721080 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:42:35.721080 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:42:35.721080 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:42:35.721080 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:42:35.721080 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 18 00:42:35.721080 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:42:35.721080 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 156/325] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Sep 18 00:42:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:42:35.726867 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43196a1b-9b63-49f1-a3c1-1f70046da7a9 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:35.769202 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:35.854818 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43196a1b-9b63-49f1-a3c1-1f70046da7a9 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:35.892669 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a60f3c-98c9-4f2c-a636-a5263f4ae98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:35.893294 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a60f3c-98c9-4f2c-a636-a5263f4ae98d None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:35.893572 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a60f3c-98c9-4f2c-a636-a5263f4ae98d None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:35.893842 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a60f3c-98c9-4f2c-a636-a5263f4ae98d None admin] PATH_INFO: `/v3/roles` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:35.894517 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a60f3c-98c9-4f2c-a636-a5263f4ae98d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:42:35.894817 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a60f3c-98c9-4f2c-a636-a5263f4ae98d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:35.896794 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a60f3c-98c9-4f2c-a636-a5263f4ae98d None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:35.906426 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 170/326] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Sep 18 00:42:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:35.911947 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8e333e-06bb-4943-a393-a53eb9deacec None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:36.014319 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:36.048645 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8e333e-06bb-4943-a393-a53eb9deacec None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:36.117721 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcbe4a0-a052-44f1-b6f3-664d9656f83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:36.118760 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcbe4a0-a052-44f1-b6f3-664d9656f83d None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:36.119219 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcbe4a0-a052-44f1-b6f3-664d9656f83d None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:36.119697 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcbe4a0-a052-44f1-b6f3-664d9656f83d None admin] PATH_INFO: `/v3/users/d50c16d6115048cc8233833439a351a6` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:36.121647 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcbe4a0-a052-44f1-b6f3-664d9656f83d None admin] RBAC: Authorizing `identity:get_user(user_id=d50c16d6115048cc8233833439a351a6)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:36.124387 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcbe4a0-a052-44f1-b6f3-664d9656f83d None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:36.131269 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 157/327] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Sep 18 00:42:35 2022] GET /identity/v3/users/d50c16d6115048cc8233833439a351a6 => generated 293 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:36.134345 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a60f3c-98c9-4f2c-a636-a5263f4ae98d None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:36.268448 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:36.282177 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a60f3c-98c9-4f2c-a636-a5263f4ae98d None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:36.326759 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85264d8-210d-44b9-b82d-e9beeb12626c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:36.327439 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85264d8-210d-44b9-b82d-e9beeb12626c None admin] REQUEST_METHOD: `PUT` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:36.327730 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85264d8-210d-44b9-b82d-e9beeb12626c None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:36.328028 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85264d8-210d-44b9-b82d-e9beeb12626c None admin] PATH_INFO: `/v3/system/users/d50c16d6115048cc8233833439a351a6/roles/21a002d535ce432597d9291135265677` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:36.329556 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85264d8-210d-44b9-b82d-e9beeb12626c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d50c16d6115048cc8233833439a351a6, role_id=21a002d535ce432597d9291135265677)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:36.330951 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85264d8-210d-44b9-b82d-e9beeb12626c None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:36.348072 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 171/328] 10.222.0.15 () {58 vars in 1334 bytes} [Sun Sep 18 00:42:36 2022] PUT /identity/v3/system/users/d50c16d6115048cc8233833439a351a6/roles/21a002d535ce432597d9291135265677 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 00:42:37.293545 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df382c-11c9-42c9-b3a9-ca1218eebeee None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:37.294359 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df382c-11c9-42c9-b3a9-ca1218eebeee None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:37.294507 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df382c-11c9-42c9-b3a9-ca1218eebeee None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:37.297054 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 158/329] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:42:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:42:37.302986 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220750d0-1810-4ad4-88c0-a6a938a0dafe None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:37.303671 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220750d0-1810-4ad4-88c0-a6a938a0dafe None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:37.303671 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220750d0-1810-4ad4-88c0-a6a938a0dafe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:37.328983 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-220750d0-1810-4ad4-88c0-a6a938a0dafe None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:42:37.330213 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-220750d0-1810-4ad4-88c0-a6a938a0dafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:42:37.438096 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 172/330] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:42:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 18 00:42:37.973233 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2df382c-11c9-42c9-b3a9-ca1218eebeee None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:38.117466 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2df382c-11c9-42c9-b3a9-ca1218eebeee None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:38.164153 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd870bce-b784-4da2-85e4-a5a5dc9f9456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:38.165231 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd870bce-b784-4da2-85e4-a5a5dc9f9456 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:38.165749 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd870bce-b784-4da2-85e4-a5a5dc9f9456 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:38.166254 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd870bce-b784-4da2-85e4-a5a5dc9f9456 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:38.209270 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd870bce-b784-4da2-85e4-a5a5dc9f9456 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:42:38.214905 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-dd870bce-b784-4da2-85e4-a5a5dc9f9456 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 18 00:42:38.214905 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:42:38.214905 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:42:38.214905 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:42:38.214905 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:42:38.214905 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:42:38.214905 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:42:38.214905 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:42:38.214905 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:42:38.214905 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:42:38.214905 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:42:38.214905 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:42:38.214905 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:42:38.214905 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:42:38.214905 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:42:38.214905 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:42:38.216656 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:42:38.216656 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:42:38.216656 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:42:38.216656 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:42:38.216656 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:42:38.216656 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:42:38.216656 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:42:38.216656 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:42:38.216656 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:42:38.216656 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:42:38.216656 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:42:38.216656 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:42:38.216656 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:42:38.216656 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:42:38.216656 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:42:38.216656 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:42:38.224578 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:42:38.224578 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:42:38.224578 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:42:38.224578 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:42:38.224578 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:42:38.224578 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:42:38.224578 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:42:38.224578 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:42:38.224578 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:42:38.224578 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:42:38.224578 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 18 00:42:38.224578 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:42:38.224578 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 159/331] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Sep 18 00:42:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:42:38.240887 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220750d0-1810-4ad4-88c0-a6a938a0dafe None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:38.373073 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:38.388725 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220750d0-1810-4ad4-88c0-a6a938a0dafe None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:38.438730 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52ce146-ffbe-4178-9b74-e4a498d1f7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:38.439410 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ce146-ffbe-4178-9b74-e4a498d1f7ba None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:38.439697 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ce146-ffbe-4178-9b74-e4a498d1f7ba None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:38.439998 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ce146-ffbe-4178-9b74-e4a498d1f7ba None admin] PATH_INFO: `/v3/roles` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:38.440735 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52ce146-ffbe-4178-9b74-e4a498d1f7ba None admin] RBAC: Adding query filter params (name=member) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:42:38.441047 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52ce146-ffbe-4178-9b74-e4a498d1f7ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:38.443070 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52ce146-ffbe-4178-9b74-e4a498d1f7ba None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:38.453279 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 173/332] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Sep 18 00:42:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:38.461907 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd870bce-b784-4da2-85e4-a5a5dc9f9456 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:38.477331 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:38.686016 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd870bce-b784-4da2-85e4-a5a5dc9f9456 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:38.745275 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57662690-8f86-4b38-99cf-f779375a363a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:38.746300 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57662690-8f86-4b38-99cf-f779375a363a None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:38.746779 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57662690-8f86-4b38-99cf-f779375a363a None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:38.747261 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57662690-8f86-4b38-99cf-f779375a363a None admin] PATH_INFO: `/v3/users/55a2ad1b7dae4bea9043e6da152eb800` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:38.749366 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57662690-8f86-4b38-99cf-f779375a363a None admin] RBAC: Authorizing `identity:get_user(user_id=55a2ad1b7dae4bea9043e6da152eb800)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:38.752171 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57662690-8f86-4b38-99cf-f779375a363a None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:38.755873 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 160/333] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Sep 18 00:42:38 2022] GET /identity/v3/users/55a2ad1b7dae4bea9043e6da152eb800 => generated 293 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:38.761627 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52ce146-ffbe-4178-9b74-e4a498d1f7ba None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:38.916602 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52ce146-ffbe-4178-9b74-e4a498d1f7ba None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:38.972077 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb027197-5bb6-4274-9d78-7a25cb32adc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:38.973576 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb027197-5bb6-4274-9d78-7a25cb32adc6 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:38.974064 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb027197-5bb6-4274-9d78-7a25cb32adc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:38.974536 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb027197-5bb6-4274-9d78-7a25cb32adc6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:38.975539 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb027197-5bb6-4274-9d78-7a25cb32adc6 None admin] RBAC: Adding query filter params (role.id=59d7218a321b4c20bc1996494a48a2a1, user.id=55a2ad1b7dae4bea9043e6da152eb800, scope.system=all) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:42:38.976062 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb027197-5bb6-4274-9d78-7a25cb32adc6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:38.977925 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb027197-5bb6-4274-9d78-7a25cb32adc6 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:38.997973 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 174/334] 10.222.0.15 () {56 vars in 1308 bytes} [Sun Sep 18 00:42:38 2022] GET /identity/v3/role_assignments?user.id=55a2ad1b7dae4bea9043e6da152eb800&scope.system=all&role.id=59d7218a321b4c20bc1996494a48a2a1 => generated 510 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:39.287388 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d04d7-acda-43e6-b8f7-cea51a54829a None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:39.287782 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d04d7-acda-43e6-b8f7-cea51a54829a None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:39.288305 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d04d7-acda-43e6-b8f7-cea51a54829a None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:39.290661 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 161/335] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:42:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:42:39.298083 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a3970-0091-4a49-8ab3-27243583f106 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:39.298551 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a3970-0091-4a49-8ab3-27243583f106 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:39.299027 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a3970-0091-4a49-8ab3-27243583f106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:39.315659 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:39.346138 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-f54a3970-0091-4a49-8ab3-27243583f106 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:42:39.348338 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-f54a3970-0091-4a49-8ab3-27243583f106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:42:39.486519 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d721a-1dcf-44c7-8853-1169af41467f None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:39.487053 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d721a-1dcf-44c7-8853-1169af41467f None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:39.487457 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d721a-1dcf-44c7-8853-1169af41467f None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:39.490806 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 162/336] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:42:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:42:39.507078 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f1ed4-b0ff-47db-bfe6-2eadb73d0f10 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:39.507386 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f1ed4-b0ff-47db-bfe6-2eadb73d0f10 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:39.507829 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f1ed4-b0ff-47db-bfe6-2eadb73d0f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:39.522303 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 175/337] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:42:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 00:42:39.552445 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-266f1ed4-b0ff-47db-bfe6-2eadb73d0f10 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:42:39.554462 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-266f1ed4-b0ff-47db-bfe6-2eadb73d0f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:42:39.694638 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 163/338] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:42:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 18 00:42:40.164726 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32dc8bd-2021-4dd2-96ae-941e1fc7c2ff None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:40.165411 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32dc8bd-2021-4dd2-96ae-941e1fc7c2ff None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:40.165895 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32dc8bd-2021-4dd2-96ae-941e1fc7c2ff None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:40.168114 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 176/339] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:42:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:42:40.173496 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b512f175-3055-4c68-8f33-13797838d825 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:40.173790 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b512f175-3055-4c68-8f33-13797838d825 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:40.174075 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b512f175-3055-4c68-8f33-13797838d825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:40.190780 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:40.200440 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-b512f175-3055-4c68-8f33-13797838d825 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:42:40.201660 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-b512f175-3055-4c68-8f33-13797838d825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:42:40.232690 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32dc8bd-2021-4dd2-96ae-941e1fc7c2ff None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:40.300540 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 164/340] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:42:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 00:42:40.380738 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32dc8bd-2021-4dd2-96ae-941e1fc7c2ff None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:40.428342 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bf63c8-b505-409e-a74d-f49bbb10d7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:40.428901 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf63c8-b505-409e-a74d-f49bbb10d7c5 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:40.429186 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf63c8-b505-409e-a74d-f49bbb10d7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:40.429464 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf63c8-b505-409e-a74d-f49bbb10d7c5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:40.432522 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:40.445033 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bf63c8-b505-409e-a74d-f49bbb10d7c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:42:40.450126 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-04bf63c8-b505-409e-a74d-f49bbb10d7c5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 18 00:42:40.450126 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:42:40.450126 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:42:40.450126 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:42:40.450126 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:42:40.450126 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:42:40.450126 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:42:40.450126 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:42:40.450126 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:42:40.450126 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:42:40.450126 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:42:40.450126 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:42:40.450126 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:42:40.450126 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:42:40.450126 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:42:40.450126 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:42:40.451754 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:42:40.451754 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:42:40.451754 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:42:40.451754 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:42:40.451754 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:42:40.451754 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:42:40.451754 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:42:40.451754 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:42:40.451754 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:42:40.451754 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:42:40.451754 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:42:40.451754 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:42:40.451754 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:42:40.451754 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:42:40.451754 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:42:40.451754 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:42:40.454094 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:42:40.454094 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:42:40.454094 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:42:40.454094 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:42:40.454094 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:42:40.454094 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:42:40.454094 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:42:40.454094 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:42:40.454094 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:42:40.454094 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:42:40.454094 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 18 00:42:40.454094 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:42:40.454094 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 177/341] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Sep 18 00:42:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:42:40.458001 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b512f175-3055-4c68-8f33-13797838d825 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:40.527958 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bf63c8-b505-409e-a74d-f49bbb10d7c5 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:40.609986 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b512f175-3055-4c68-8f33-13797838d825 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:40.676805 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c02f1d5-5953-4c29-8ece-ac3312d43f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:40.677456 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02f1d5-5953-4c29-8ece-ac3312d43f93 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:40.677743 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02f1d5-5953-4c29-8ece-ac3312d43f93 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:40.678020 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02f1d5-5953-4c29-8ece-ac3312d43f93 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:40.678793 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c02f1d5-5953-4c29-8ece-ac3312d43f93 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:42:40.679020 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c02f1d5-5953-4c29-8ece-ac3312d43f93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:40.680644 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c02f1d5-5953-4c29-8ece-ac3312d43f93 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:40.690234 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 165/342] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Sep 18 00:42:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:40.691023 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:40.700938 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c02f1d5-5953-4c29-8ece-ac3312d43f93 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:40.722367 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bf63c8-b505-409e-a74d-f49bbb10d7c5 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:40.778186 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fc428a-6279-4fa0-8399-282c6ebe7b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:40.778844 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc428a-6279-4fa0-8399-282c6ebe7b22 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:40.779122 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc428a-6279-4fa0-8399-282c6ebe7b22 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:40.779395 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc428a-6279-4fa0-8399-282c6ebe7b22 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:40.796039 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fc428a-6279-4fa0-8399-282c6ebe7b22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:42:40.805148 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-c2fc428a-6279-4fa0-8399-282c6ebe7b22 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 18 00:42:40.805148 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:42:40.805148 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:42:40.805148 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:42:40.805148 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:42:40.805148 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:42:40.805148 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:42:40.805148 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:42:40.805148 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:42:40.805148 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:42:40.805148 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:42:40.805148 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:42:40.805148 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:42:40.805148 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:42:40.805148 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:42:40.805148 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:42:40.807316 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:42:40.807316 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:42:40.807316 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:42:40.807316 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:42:40.807316 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:42:40.807316 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:42:40.807316 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:42:40.807316 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:42:40.807316 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:42:40.807316 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:42:40.807316 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:42:40.807316 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:42:40.807316 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:42:40.807316 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:42:40.807316 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:42:40.807316 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:42:40.808924 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:42:40.808924 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:42:40.808924 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:42:40.808924 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:42:40.808924 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:42:40.808924 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:42:40.808924 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:42:40.808924 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:42:40.808924 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:42:40.808924 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:42:40.808924 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 18 00:42:40.808924 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:42:40.808924 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 178/343] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Sep 18 00:42:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:42:40.824987 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fc428a-6279-4fa0-8399-282c6ebe7b22 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:40.863337 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c02f1d5-5953-4c29-8ece-ac3312d43f93 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:40.928909 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc52911-5249-411a-842a-ecae00fc08e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:40.929453 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc52911-5249-411a-842a-ecae00fc08e2 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:40.929784 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc52911-5249-411a-842a-ecae00fc08e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:40.930031 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc52911-5249-411a-842a-ecae00fc08e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:40.932661 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:41.001183 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fc428a-6279-4fa0-8399-282c6ebe7b22 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:41.033512 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:41.042597 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc52911-5249-411a-842a-ecae00fc08e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:41.044190 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc52911-5249-411a-842a-ecae00fc08e2 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:41.085233 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904643c1-40bb-478a-9ad5-f806d280e787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:41.085872 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904643c1-40bb-478a-9ad5-f806d280e787 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:41.086501 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904643c1-40bb-478a-9ad5-f806d280e787 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:41.086501 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904643c1-40bb-478a-9ad5-f806d280e787 None admin] PATH_INFO: `/v3/roles` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:41.087095 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904643c1-40bb-478a-9ad5-f806d280e787 None admin] RBAC: Adding query filter params (name=member) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:42:41.087400 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904643c1-40bb-478a-9ad5-f806d280e787 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:41.097348 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904643c1-40bb-478a-9ad5-f806d280e787 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:41.134423 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 179/344] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Sep 18 00:42:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:41.135376 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904643c1-40bb-478a-9ad5-f806d280e787 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:41.238013 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 166/345] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Sep 18 00:42:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 00:42:41.238942 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc52911-5249-411a-842a-ecae00fc08e2 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:41.372133 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904643c1-40bb-478a-9ad5-f806d280e787 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:41.404955 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:41.419854 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:41.425127 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc52911-5249-411a-842a-ecae00fc08e2 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:41.432595 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deabf79b-a1a3-4021-b3d6-b175ae11bfaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:41.433266 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabf79b-a1a3-4021-b3d6-b175ae11bfaf None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:41.433554 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabf79b-a1a3-4021-b3d6-b175ae11bfaf None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:41.433827 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabf79b-a1a3-4021-b3d6-b175ae11bfaf None admin] PATH_INFO: `/v3/roles/member` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:41.454807 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deabf79b-a1a3-4021-b3d6-b175ae11bfaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:42:41.463974 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-deabf79b-a1a3-4021-b3d6-b175ae11bfaf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 18 00:42:41.463974 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:42:41.463974 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:42:41.463974 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:42:41.463974 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:42:41.463974 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:42:41.463974 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:42:41.463974 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:42:41.463974 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:42:41.463974 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:42:41.463974 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:42:41.463974 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:42:41.463974 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:42:41.463974 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:42:41.463974 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:42:41.463974 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:42:41.464961 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:42:41.464961 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:42:41.464961 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:42:41.464961 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:42:41.464961 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:42:41.464961 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:42:41.464961 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:42:41.464961 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:42:41.464961 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:42:41.464961 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:42:41.464961 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:42:41.464961 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:42:41.464961 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:42:41.464961 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:42:41.464961 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:42:41.464961 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:42:41.465850 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:42:41.465850 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:42:41.465850 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:42:41.465850 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:42:41.465850 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:42:41.465850 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:42:41.465850 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:42:41.465850 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:42:41.465850 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:42:41.465850 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:42:41.465850 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 18 00:42:41.465850 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:42:41.465850 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 180/346] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Sep 18 00:42:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:42:41.471295 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deabf79b-a1a3-4021-b3d6-b175ae11bfaf None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:41.499106 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfcc983-3146-428a-b6b3-0ce91624832b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:41.500449 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfcc983-3146-428a-b6b3-0ce91624832b None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:41.503686 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfcc983-3146-428a-b6b3-0ce91624832b None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:41.505047 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfcc983-3146-428a-b6b3-0ce91624832b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:41.623826 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfcc983-3146-428a-b6b3-0ce91624832b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:41.626064 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfcc983-3146-428a-b6b3-0ce91624832b None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:41.638720 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deabf79b-a1a3-4021-b3d6-b175ae11bfaf None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:41.700404 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a454f86b-492c-4b1e-8790-ac17d168190d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:41.702102 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454f86b-492c-4b1e-8790-ac17d168190d None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:41.702609 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454f86b-492c-4b1e-8790-ac17d168190d None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:41.703383 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454f86b-492c-4b1e-8790-ac17d168190d None admin] PATH_INFO: `/v3/projects/71680fa1985e4fc4a5c1a73f87753f66` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:41.705092 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a454f86b-492c-4b1e-8790-ac17d168190d None admin] RBAC: Authorizing `identity:get_project(project_id=71680fa1985e4fc4a5c1a73f87753f66)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:41.706924 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a454f86b-492c-4b1e-8790-ac17d168190d None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:41.710278 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 181/347] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Sep 18 00:42:41 2022] GET /identity/v3/projects/71680fa1985e4fc4a5c1a73f87753f66 => generated 298 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:41.717789 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a2e4a-9318-4326-9fc8-cc0fe5317ea2 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:41.718322 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a2e4a-9318-4326-9fc8-cc0fe5317ea2 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:41.718809 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a2e4a-9318-4326-9fc8-cc0fe5317ea2 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:41.721911 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 182/348] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:42:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:42:41.724282 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d37a0-937a-4b17-ab46-d368c9c9313f None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:41.724776 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d37a0-937a-4b17-ab46-d368c9c9313f None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:41.725266 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d37a0-937a-4b17-ab46-d368c9c9313f None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:41.727992 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 183/349] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:42:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:42:41.729256 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d37a0-937a-4b17-ab46-d368c9c9313f None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:41.778892 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:41.782776 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 167/350] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Sep 18 00:42:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 00:42:41.783682 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfcc983-3146-428a-b6b3-0ce91624832b None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:41.830310 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:41.903649 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d37a0-937a-4b17-ab46-d368c9c9313f None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:41.942621 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfcc983-3146-428a-b6b3-0ce91624832b None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:41.954512 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779297b5-8a9d-4663-9f71-2df64e4a7506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:41.955146 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779297b5-8a9d-4663-9f71-2df64e4a7506 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:41.955431 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779297b5-8a9d-4663-9f71-2df64e4a7506 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:41.955710 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779297b5-8a9d-4663-9f71-2df64e4a7506 None admin] PATH_INFO: `/v3/roles` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:41.956420 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779297b5-8a9d-4663-9f71-2df64e4a7506 None admin] RBAC: Adding query filter params (name=member) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:42:41.956731 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779297b5-8a9d-4663-9f71-2df64e4a7506 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:41.958319 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779297b5-8a9d-4663-9f71-2df64e4a7506 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:41.969447 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 184/351] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Sep 18 00:42:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:41.970744 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ba780-8557-4209-a6bd-aeebf77ef525 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:41.971031 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ba780-8557-4209-a6bd-aeebf77ef525 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:41.971311 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ba780-8557-4209-a6bd-aeebf77ef525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:41.991024 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-403ba780-8557-4209-a6bd-aeebf77ef525 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:42:41.994037 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-403ba780-8557-4209-a6bd-aeebf77ef525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:42:42.003196 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f3e2d2-9851-4172-a64f-9bffc56455f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:42.004810 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3e2d2-9851-4172-a64f-9bffc56455f4 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:42.005273 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3e2d2-9851-4172-a64f-9bffc56455f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:42.005724 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3e2d2-9851-4172-a64f-9bffc56455f4 None admin] PATH_INFO: `/v3/groups/15caa6296a0b49ebb84ae27cf4744cfc` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:42.014621 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f3e2d2-9851-4172-a64f-9bffc56455f4 None admin] RBAC: Authorizing `identity:get_group(group_id=15caa6296a0b49ebb84ae27cf4744cfc)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:42.018699 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f3e2d2-9851-4172-a64f-9bffc56455f4 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:42.023772 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 168/352] 10.222.0.15 () {56 vars in 1180 bytes} [Sun Sep 18 00:42:41 2022] GET /identity/v3/groups/15caa6296a0b49ebb84ae27cf4744cfc => generated 226 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:42.027933 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ef5a0-1677-4c99-bd75-8b62b8ee96ed None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:42.027933 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ef5a0-1677-4c99-bd75-8b62b8ee96ed None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:42.028143 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ef5a0-1677-4c99-bd75-8b62b8ee96ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:42.058994 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-3e0ef5a0-1677-4c99-bd75-8b62b8ee96ed None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:42:42.060181 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-3e0ef5a0-1677-4c99-bd75-8b62b8ee96ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:42:42.089265 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 185/353] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:42:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 00:42:42.091232 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ba780-8557-4209-a6bd-aeebf77ef525 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:42.136354 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:42.173385 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:42.195831 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 169/354] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:42:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 00:42:42.197387 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0ef5a0-1677-4c99-bd75-8b62b8ee96ed None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:42.223679 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ba780-8557-4209-a6bd-aeebf77ef525 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:42.268205 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f9af3-6784-4ba8-9b19-cbd643a6d7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:42.269098 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f9af3-6784-4ba8-9b19-cbd643a6d7ee None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:42.269590 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f9af3-6784-4ba8-9b19-cbd643a6d7ee None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:42.270157 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f9af3-6784-4ba8-9b19-cbd643a6d7ee None admin] PATH_INFO: `/v3/projects/71680fa1985e4fc4a5c1a73f87753f66` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:42.271569 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9f9af3-6784-4ba8-9b19-cbd643a6d7ee None admin] RBAC: Authorizing `identity:get_project(project_id=71680fa1985e4fc4a5c1a73f87753f66)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:42.273255 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9f9af3-6784-4ba8-9b19-cbd643a6d7ee None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:42.275457 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 186/355] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Sep 18 00:42:42 2022] GET /identity/v3/projects/71680fa1985e4fc4a5c1a73f87753f66 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:42.276587 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f9af3-6784-4ba8-9b19-cbd643a6d7ee None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:42.407332 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f9af3-6784-4ba8-9b19-cbd643a6d7ee None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:42.411876 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:42.417020 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0ef5a0-1677-4c99-bd75-8b62b8ee96ed None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:42.453395 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dce685-696a-4840-af52-229878674f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:42.454341 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dce685-696a-4840-af52-229878674f5d None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:42.454816 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dce685-696a-4840-af52-229878674f5d None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:42.455259 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dce685-696a-4840-af52-229878674f5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:42.456205 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dce685-696a-4840-af52-229878674f5d None admin] RBAC: Adding query filter params (group.id=15caa6296a0b49ebb84ae27cf4744cfc, role.id=e2a7bd363c424c5380514254ad1cc522, scope.project.id=71680fa1985e4fc4a5c1a73f87753f66) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:42:42.456717 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dce685-696a-4840-af52-229878674f5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:42.458875 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cfc096-9e9b-4253-9313-4538b23aa528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:42.459033 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dce685-696a-4840-af52-229878674f5d None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:42.459502 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cfc096-9e9b-4253-9313-4538b23aa528 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:42.459787 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cfc096-9e9b-4253-9313-4538b23aa528 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:42.460122 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cfc096-9e9b-4253-9313-4538b23aa528 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:42.466840 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 187/356] 10.222.0.15 () {56 vars in 1376 bytes} [Sun Sep 18 00:42:42 2022] GET /identity/v3/role_assignments?group.id=15caa6296a0b49ebb84ae27cf4744cfc&scope.project.id=71680fa1985e4fc4a5c1a73f87753f66&role.id=e2a7bd363c424c5380514254ad1cc522 => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:42.468005 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dce685-696a-4840-af52-229878674f5d None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:42.581340 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:42.585583 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cfc096-9e9b-4253-9313-4538b23aa528 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:42.587028 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cfc096-9e9b-4253-9313-4538b23aa528 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:42.681523 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dce685-696a-4840-af52-229878674f5d None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:42.734550 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38a1e8-ef8e-4e3c-8815-61e916f880fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:42.736419 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38a1e8-ef8e-4e3c-8815-61e916f880fb None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:42.737088 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38a1e8-ef8e-4e3c-8815-61e916f880fb None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:42.737682 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38a1e8-ef8e-4e3c-8815-61e916f880fb None admin] PATH_INFO: `/v3/groups/15caa6296a0b49ebb84ae27cf4744cfc` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:42.740221 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a38a1e8-ef8e-4e3c-8815-61e916f880fb None admin] RBAC: Authorizing `identity:get_group(group_id=15caa6296a0b49ebb84ae27cf4744cfc)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:42.740478 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 170/357] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Sep 18 00:42:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 00:42:42.741838 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f629a-ba18-466f-88d2-2569f94691c3 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:42.742127 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f629a-ba18-466f-88d2-2569f94691c3 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:42.742404 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f629a-ba18-466f-88d2-2569f94691c3 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:42.742511 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a38a1e8-ef8e-4e3c-8815-61e916f880fb None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:42.745084 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 188/358] 10.222.0.15 () {56 vars in 1180 bytes} [Sun Sep 18 00:42:42 2022] GET /identity/v3/groups/15caa6296a0b49ebb84ae27cf4744cfc => generated 226 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:42.745084 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38a1e8-ef8e-4e3c-8815-61e916f880fb None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:42.748931 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 171/359] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:42:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:42:42.749855 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f629a-ba18-466f-88d2-2569f94691c3 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:42.798726 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:42.871934 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:42.885039 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f629a-ba18-466f-88d2-2569f94691c3 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:42.894723 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38a1e8-ef8e-4e3c-8815-61e916f880fb None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:42.948681 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8032211-5ae8-485d-a3a8-9b97145b5c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:42.949300 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8032211-5ae8-485d-a3a8-9b97145b5c44 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:42.949582 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8032211-5ae8-485d-a3a8-9b97145b5c44 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:42.949857 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8032211-5ae8-485d-a3a8-9b97145b5c44 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:42.964510 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8032211-5ae8-485d-a3a8-9b97145b5c44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:42:42.964700 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d0538f-8401-44d5-8d08-e83d05fac9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:42.965275 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0538f-8401-44d5-8d08-e83d05fac9ec None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:42.966956 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0538f-8401-44d5-8d08-e83d05fac9ec None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:42.966956 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0538f-8401-44d5-8d08-e83d05fac9ec None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:42.970110 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-b8032211-5ae8-485d-a3a8-9b97145b5c44 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 18 00:42:42.970110 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:42:42.970110 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:42:42.970110 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:42:42.970110 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:42:42.970110 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:42:42.970110 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:42:42.970110 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:42:42.970110 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:42:42.970110 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:42:42.970110 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:42:42.970110 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:42:42.970110 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:42:42.970110 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:42:42.970110 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:42:42.970110 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:42:42.971050 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:42:42.971050 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:42:42.971050 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:42:42.971050 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:42:42.971050 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:42:42.971050 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:42:42.971050 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:42:42.971050 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:42:42.971050 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:42:42.971050 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:42:42.971050 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:42:42.971050 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:42:42.971050 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:42:42.971050 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:42:42.971050 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:42:42.971050 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:42:42.971827 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:42:42.971827 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:42:42.971827 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:42:42.971827 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:42:42.971827 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:42:42.971827 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:42:42.971827 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:42:42.971827 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:42:42.971827 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:42:42.971827 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:42:42.971827 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 18 00:42:42.971827 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:42:42.971827 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 189/360] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Sep 18 00:42:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:42:42.976329 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8032211-5ae8-485d-a3a8-9b97145b5c44 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:42.983668 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d0538f-8401-44d5-8d08-e83d05fac9ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:42:42.990802 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-08d0538f-8401-44d5-8d08-e83d05fac9ec None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 18 00:42:42.990802 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:42:42.990802 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:42:42.990802 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:42:42.990802 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:42:42.990802 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:42:42.990802 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:42:42.990802 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:42:42.990802 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:42:42.990802 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:42:42.990802 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:42:42.990802 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:42:42.990802 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:42:42.990802 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:42:42.990802 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:42:42.990802 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:42:42.992555 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:42:42.992555 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:42:42.992555 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:42:42.992555 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:42:42.992555 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:42:42.992555 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:42:42.992555 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:42:42.992555 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:42:42.992555 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:42:42.992555 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:42:42.992555 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:42:42.992555 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:42:42.992555 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:42:42.992555 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:42:42.992555 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:42:42.992555 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:42:42.993340 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:42:42.993340 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:42:42.993340 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:42:42.993340 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:42:42.993340 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:42:42.993340 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:42:42.993340 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:42:42.993340 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:42:42.993340 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:42:42.993340 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:42:42.993340 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 18 00:42:42.993340 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:42:42.993340 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 172/361] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Sep 18 00:42:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:42:42.993340 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659abfa9-f893-40b9-b610-a3ad29db54a5 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:42.994452 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659abfa9-f893-40b9-b610-a3ad29db54a5 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:42.994452 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659abfa9-f893-40b9-b610-a3ad29db54a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:43.024193 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-659abfa9-f893-40b9-b610-a3ad29db54a5 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:42:43.026318 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-659abfa9-f893-40b9-b610-a3ad29db54a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:42:43.102824 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:43.113451 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8032211-5ae8-485d-a3a8-9b97145b5c44 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:43.150648 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 173/362] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:42:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 00:42:43.151853 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659abfa9-f893-40b9-b610-a3ad29db54a5 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:43.177588 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e63896-e64c-40dd-b6f8-42fae0ce244a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:43.179237 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e63896-e64c-40dd-b6f8-42fae0ce244a None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:43.180062 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e63896-e64c-40dd-b6f8-42fae0ce244a None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:43.180834 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e63896-e64c-40dd-b6f8-42fae0ce244a None admin] PATH_INFO: `/v3/projects/14cc5534b3054dfbbc19e546f4d51538` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:43.183010 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e63896-e64c-40dd-b6f8-42fae0ce244a None admin] RBAC: Authorizing `identity:get_project(project_id=14cc5534b3054dfbbc19e546f4d51538)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:43.186162 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e63896-e64c-40dd-b6f8-42fae0ce244a None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:43.189675 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 190/363] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Sep 18 00:42:42 2022] GET /identity/v3/projects/14cc5534b3054dfbbc19e546f4d51538 => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:43.191383 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e63896-e64c-40dd-b6f8-42fae0ce244a None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:43.331289 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:43.373993 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659abfa9-f893-40b9-b610-a3ad29db54a5 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:43.386339 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e63896-e64c-40dd-b6f8-42fae0ce244a None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:43.455195 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb838da-a231-4e8b-90a6-40e6652aa489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:43.458002 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb838da-a231-4e8b-90a6-40e6652aa489 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:43.458002 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb838da-a231-4e8b-90a6-40e6652aa489 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:43.458002 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb838da-a231-4e8b-90a6-40e6652aa489 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:43.458621 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb838da-a231-4e8b-90a6-40e6652aa489 None admin] RBAC: Adding query filter params (group.id=15caa6296a0b49ebb84ae27cf4744cfc, role.id=59d7218a321b4c20bc1996494a48a2a1, scope.project.id=71680fa1985e4fc4a5c1a73f87753f66) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:42:43.459279 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb838da-a231-4e8b-90a6-40e6652aa489 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:43.462662 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb838da-a231-4e8b-90a6-40e6652aa489 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:43.463321 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a6646c-cbd0-45bd-b7e9-4fc81d7cc1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:43.464677 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6646c-cbd0-45bd-b7e9-4fc81d7cc1bb None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:43.465392 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6646c-cbd0-45bd-b7e9-4fc81d7cc1bb None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:43.466214 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6646c-cbd0-45bd-b7e9-4fc81d7cc1bb None admin] PATH_INFO: `/v3/roles` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:43.467643 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a6646c-cbd0-45bd-b7e9-4fc81d7cc1bb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:42:43.468632 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a6646c-cbd0-45bd-b7e9-4fc81d7cc1bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:43.471300 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a6646c-cbd0-45bd-b7e9-4fc81d7cc1bb None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:43.477909 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 174/364] 10.222.0.15 () {56 vars in 1376 bytes} [Sun Sep 18 00:42:43 2022] GET /identity/v3/role_assignments?group.id=15caa6296a0b49ebb84ae27cf4744cfc&scope.project.id=71680fa1985e4fc4a5c1a73f87753f66&role.id=59d7218a321b4c20bc1996494a48a2a1 => generated 260 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:43.483846 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb838da-a231-4e8b-90a6-40e6652aa489 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:43.489562 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 191/365] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Sep 18 00:42:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:43.491824 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a6646c-cbd0-45bd-b7e9-4fc81d7cc1bb None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:43.554720 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:43.725646 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a6646c-cbd0-45bd-b7e9-4fc81d7cc1bb None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:43.736740 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb838da-a231-4e8b-90a6-40e6652aa489 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:43.795543 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78fb1b-a638-4d52-973b-85a6c7ac1350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:43.798225 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78fb1b-a638-4d52-973b-85a6c7ac1350 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:43.798629 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea150a70-86a4-45fe-8f1e-351010d14e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:43.799156 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78fb1b-a638-4d52-973b-85a6c7ac1350 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:43.799653 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea150a70-86a4-45fe-8f1e-351010d14e50 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:43.799875 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78fb1b-a638-4d52-973b-85a6c7ac1350 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:43.800277 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea150a70-86a4-45fe-8f1e-351010d14e50 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:43.800684 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea150a70-86a4-45fe-8f1e-351010d14e50 None admin] PATH_INFO: `/v3/groups/15caa6296a0b49ebb84ae27cf4744cfc` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:43.802723 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae78fb1b-a638-4d52-973b-85a6c7ac1350 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:42:43.802853 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea150a70-86a4-45fe-8f1e-351010d14e50 None admin] RBAC: Authorizing `identity:get_group(group_id=15caa6296a0b49ebb84ae27cf4744cfc)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:43.803469 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae78fb1b-a638-4d52-973b-85a6c7ac1350 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:43.804790 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea150a70-86a4-45fe-8f1e-351010d14e50 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:43.806275 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae78fb1b-a638-4d52-973b-85a6c7ac1350 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:43.806962 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 192/366] 10.222.0.15 () {56 vars in 1180 bytes} [Sun Sep 18 00:42:43 2022] GET /identity/v3/groups/15caa6296a0b49ebb84ae27cf4744cfc => generated 226 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:43.808119 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea150a70-86a4-45fe-8f1e-351010d14e50 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:43.823208 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 175/367] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Sep 18 00:42:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:43.828619 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78fb1b-a638-4d52-973b-85a6c7ac1350 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:43.844502 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:43.974121 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:43.992009 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea150a70-86a4-45fe-8f1e-351010d14e50 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:44.033949 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ac666a-b74f-4845-8b69-b9bf237cbde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:44.035038 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac666a-b74f-4845-8b69-b9bf237cbde1 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:44.035553 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac666a-b74f-4845-8b69-b9bf237cbde1 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:44.036027 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac666a-b74f-4845-8b69-b9bf237cbde1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:44.051686 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ac666a-b74f-4845-8b69-b9bf237cbde1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:42:44.058695 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-95ac666a-b74f-4845-8b69-b9bf237cbde1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 00:42:44.058695 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:42:44.058695 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:42:44.058695 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:42:44.058695 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:42:44.058695 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:42:44.058695 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:42:44.058695 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:42:44.058695 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:42:44.058695 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:42:44.058695 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:42:44.058695 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:42:44.058695 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:42:44.058695 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:42:44.058695 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:42:44.058695 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:42:44.059795 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:42:44.059795 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:42:44.059795 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:42:44.059795 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:42:44.059795 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:42:44.059795 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:42:44.059795 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:42:44.059795 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:42:44.059795 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:42:44.059795 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:42:44.059795 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:42:44.059795 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:42:44.059795 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:42:44.059795 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:42:44.059795 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:42:44.059795 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:42:44.060715 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:42:44.060715 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:42:44.060715 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:42:44.060715 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:42:44.060715 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:42:44.060715 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:42:44.060715 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:42:44.060715 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:42:44.060715 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:42:44.060715 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:42:44.060715 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 00:42:44.060715 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:42:44.064058 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 193/368] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Sep 18 00:42:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:42:44.065164 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ac666a-b74f-4845-8b69-b9bf237cbde1 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:44.112525 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78fb1b-a638-4d52-973b-85a6c7ac1350 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:44.190807 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c654f1-e4da-4ca1-865c-27857d60bd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:44.192124 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c654f1-e4da-4ca1-865c-27857d60bd5d None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:44.192819 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c654f1-e4da-4ca1-865c-27857d60bd5d None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:44.193506 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c654f1-e4da-4ca1-865c-27857d60bd5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:44.195121 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ac666a-b74f-4845-8b69-b9bf237cbde1 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:44.254897 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d1b019-2f0d-4f2e-afff-24cf6be94db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:44.255928 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1b019-2f0d-4f2e-afff-24cf6be94db9 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:44.256424 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1b019-2f0d-4f2e-afff-24cf6be94db9 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:44.256923 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1b019-2f0d-4f2e-afff-24cf6be94db9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:44.258168 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d1b019-2f0d-4f2e-afff-24cf6be94db9 None admin] RBAC: Adding query filter params (group.id=15caa6296a0b49ebb84ae27cf4744cfc, role.id=59d7218a321b4c20bc1996494a48a2a1, scope.project.id=14cc5534b3054dfbbc19e546f4d51538) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:42:44.258732 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d1b019-2f0d-4f2e-afff-24cf6be94db9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:44.260457 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d1b019-2f0d-4f2e-afff-24cf6be94db9 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:44.269454 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 194/369] 10.222.0.15 () {56 vars in 1376 bytes} [Sun Sep 18 00:42:44 2022] GET /identity/v3/role_assignments?group.id=15caa6296a0b49ebb84ae27cf4744cfc&scope.project.id=14cc5534b3054dfbbc19e546f4d51538&role.id=59d7218a321b4c20bc1996494a48a2a1 => generated 260 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:44.270666 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d1b019-2f0d-4f2e-afff-24cf6be94db9 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:44.322124 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c654f1-e4da-4ca1-865c-27857d60bd5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:44.322761 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:44.325460 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c654f1-e4da-4ca1-865c-27857d60bd5d None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:44.339553 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:44.493501 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 176/370] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Sep 18 00:42:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 669 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 00:42:44.502539 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c654f1-e4da-4ca1-865c-27857d60bd5d None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:44.548062 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d1b019-2f0d-4f2e-afff-24cf6be94db9 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:44.612341 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e68df-13d2-419a-b288-1cabff676654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:44.613954 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e68df-13d2-419a-b288-1cabff676654 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:44.614463 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e68df-13d2-419a-b288-1cabff676654 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:44.614954 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e68df-13d2-419a-b288-1cabff676654 None admin] PATH_INFO: `/v3/users/d50c16d6115048cc8233833439a351a6` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:44.622506 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090e68df-13d2-419a-b288-1cabff676654 None admin] RBAC: Authorizing `identity:get_user(user_id=d50c16d6115048cc8233833439a351a6)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:44.627285 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090e68df-13d2-419a-b288-1cabff676654 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:44.630688 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 195/371] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Sep 18 00:42:44 2022] GET /identity/v3/users/d50c16d6115048cc8233833439a351a6 => generated 293 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:44.637997 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e68df-13d2-419a-b288-1cabff676654 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:44.755759 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:44.775372 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e68df-13d2-419a-b288-1cabff676654 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:44.816057 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0006e238-6130-461e-95c6-c1f94d968ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:44.817192 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006e238-6130-461e-95c6-c1f94d968ab6 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:44.817649 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006e238-6130-461e-95c6-c1f94d968ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:44.818082 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006e238-6130-461e-95c6-c1f94d968ab6 None admin] PATH_INFO: `/v3/projects/14cc5534b3054dfbbc19e546f4d51538` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:44.819612 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0006e238-6130-461e-95c6-c1f94d968ab6 None admin] RBAC: Authorizing `identity:get_project(project_id=14cc5534b3054dfbbc19e546f4d51538)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:44.821505 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0006e238-6130-461e-95c6-c1f94d968ab6 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:44.823918 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 196/372] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Sep 18 00:42:44 2022] GET /identity/v3/projects/14cc5534b3054dfbbc19e546f4d51538 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:44.825008 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0006e238-6130-461e-95c6-c1f94d968ab6 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:44.846259 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c654f1-e4da-4ca1-865c-27857d60bd5d None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:44.861624 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:44.927165 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baed76f-7bbb-4ef8-9b36-6385fab5960a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:44.928168 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baed76f-7bbb-4ef8-9b36-6385fab5960a None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:44.928607 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baed76f-7bbb-4ef8-9b36-6385fab5960a None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:44.929031 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baed76f-7bbb-4ef8-9b36-6385fab5960a None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:44.929900 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baed76f-7bbb-4ef8-9b36-6385fab5960a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:42:44.930395 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baed76f-7bbb-4ef8-9b36-6385fab5960a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:44.932050 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baed76f-7bbb-4ef8-9b36-6385fab5960a None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:44.952288 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 177/373] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Sep 18 00:42:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 458 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:44.956712 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baed76f-7bbb-4ef8-9b36-6385fab5960a None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:45.076920 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0006e238-6130-461e-95c6-c1f94d968ab6 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:45.123956 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de6b63-3d5c-47ff-ad7e-0e81ec7d18a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:45.125337 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de6b63-3d5c-47ff-ad7e-0e81ec7d18a3 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:45.125779 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de6b63-3d5c-47ff-ad7e-0e81ec7d18a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:45.126196 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de6b63-3d5c-47ff-ad7e-0e81ec7d18a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:45.127085 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48de6b63-3d5c-47ff-ad7e-0e81ec7d18a3 None admin] RBAC: Adding query filter params (role.id=21a002d535ce432597d9291135265677, user.id=d50c16d6115048cc8233833439a351a6, scope.system=all) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:42:45.127568 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48de6b63-3d5c-47ff-ad7e-0e81ec7d18a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:45.130022 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48de6b63-3d5c-47ff-ad7e-0e81ec7d18a3 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:45.153041 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 197/374] 10.222.0.15 () {56 vars in 1308 bytes} [Sun Sep 18 00:42:44 2022] GET /identity/v3/role_assignments?user.id=d50c16d6115048cc8233833439a351a6&scope.system=all&role.id=21a002d535ce432597d9291135265677 => generated 510 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:45.159745 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de6b63-3d5c-47ff-ad7e-0e81ec7d18a3 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:45.206843 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:45.294953 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baed76f-7bbb-4ef8-9b36-6385fab5960a None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:45.385840 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de6b63-3d5c-47ff-ad7e-0e81ec7d18a3 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:45.425885 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c1ec8a-95f5-4bfc-891d-f9cc8a8ad965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:45.426811 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c1ec8a-95f5-4bfc-891d-f9cc8a8ad965 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:45.427267 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c1ec8a-95f5-4bfc-891d-f9cc8a8ad965 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:45.427665 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c1ec8a-95f5-4bfc-891d-f9cc8a8ad965 None admin] PATH_INFO: `/v3/groups/15caa6296a0b49ebb84ae27cf4744cfc` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:45.432824 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c1ec8a-95f5-4bfc-891d-f9cc8a8ad965 None admin] RBAC: Authorizing `identity:get_group(group_id=15caa6296a0b49ebb84ae27cf4744cfc)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:45.434772 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c1ec8a-95f5-4bfc-891d-f9cc8a8ad965 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:45.437293 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 178/375] 10.222.0.15 () {56 vars in 1180 bytes} [Sun Sep 18 00:42:44 2022] GET /identity/v3/groups/15caa6296a0b49ebb84ae27cf4744cfc => generated 226 bytes in 481 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:45.447242 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c1ec8a-95f5-4bfc-891d-f9cc8a8ad965 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:45.487113 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe51127-8c4d-4164-87f1-b74fc410d44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:45.492230 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe51127-8c4d-4164-87f1-b74fc410d44e None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:45.492839 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe51127-8c4d-4164-87f1-b74fc410d44e None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:45.493341 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe51127-8c4d-4164-87f1-b74fc410d44e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:45.574865 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:45.683943 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe51127-8c4d-4164-87f1-b74fc410d44e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:45.685469 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe51127-8c4d-4164-87f1-b74fc410d44e None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:45.711482 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:45.759491 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c1ec8a-95f5-4bfc-891d-f9cc8a8ad965 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:45.833167 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71aa1e0-fe2c-4346-835d-cc1f69bbf475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:45.834086 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 198/376] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Sep 18 00:42:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 675 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 00:42:45.834615 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71aa1e0-fe2c-4346-835d-cc1f69bbf475 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:45.834769 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71aa1e0-fe2c-4346-835d-cc1f69bbf475 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:45.835186 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71aa1e0-fe2c-4346-835d-cc1f69bbf475 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:45.836070 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71aa1e0-fe2c-4346-835d-cc1f69bbf475 None admin] RBAC: Adding query filter params (group.id=15caa6296a0b49ebb84ae27cf4744cfc, role.id=e2a7bd363c424c5380514254ad1cc522, scope.project.id=14cc5534b3054dfbbc19e546f4d51538) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:42:45.836487 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71aa1e0-fe2c-4346-835d-cc1f69bbf475 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:45.836756 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3f2ab-5c6b-41d1-839e-41765d656147 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:45.837178 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3f2ab-5c6b-41d1-839e-41765d656147 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:45.837584 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3f2ab-5c6b-41d1-839e-41765d656147 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:45.838386 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71aa1e0-fe2c-4346-835d-cc1f69bbf475 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:45.839289 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 199/377] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:42:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:42:45.840481 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c3f2ab-5c6b-41d1-839e-41765d656147 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:45.847059 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 179/378] 10.222.0.15 () {56 vars in 1376 bytes} [Sun Sep 18 00:42:45 2022] GET /identity/v3/role_assignments?group.id=15caa6296a0b49ebb84ae27cf4744cfc&scope.project.id=14cc5534b3054dfbbc19e546f4d51538&role.id=e2a7bd363c424c5380514254ad1cc522 => generated 260 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:45.848733 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da2e41-6872-4178-ae10-2e0bcb715038 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:45.849125 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da2e41-6872-4178-ae10-2e0bcb715038 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:45.849503 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da2e41-6872-4178-ae10-2e0bcb715038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:45.882718 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-22da2e41-6872-4178-ae10-2e0bcb715038 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:42:45.884359 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-22da2e41-6872-4178-ae10-2e0bcb715038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:42:46.000291 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 180/379] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:42:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 00:42:46.035770 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c3f2ab-5c6b-41d1-839e-41765d656147 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:46.056355 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:46.085607 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736fb6aa-d293-4ec6-bc75-fd3398ad8c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:46.086298 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736fb6aa-d293-4ec6-bc75-fd3398ad8c0c None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:46.086639 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736fb6aa-d293-4ec6-bc75-fd3398ad8c0c None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:46.086922 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736fb6aa-d293-4ec6-bc75-fd3398ad8c0c None admin] PATH_INFO: `/v3/projects/59ffbd91d29d4939bf7137c10c138592` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:46.088331 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736fb6aa-d293-4ec6-bc75-fd3398ad8c0c None admin] RBAC: Authorizing `identity:get_project(project_id=59ffbd91d29d4939bf7137c10c138592)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:46.089853 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736fb6aa-d293-4ec6-bc75-fd3398ad8c0c None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:46.092213 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 200/380] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Sep 18 00:42:45 2022] GET /identity/v3/projects/59ffbd91d29d4939bf7137c10c138592 => generated 344 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:42:46.098196 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22da2e41-6872-4178-ae10-2e0bcb715038 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:46.147927 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:46.301547 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22da2e41-6872-4178-ae10-2e0bcb715038 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:46.359576 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7afcee6-37be-4ec9-ab2c-8575328e3d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:46.360865 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7afcee6-37be-4ec9-ab2c-8575328e3d7e None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:46.361434 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7afcee6-37be-4ec9-ab2c-8575328e3d7e None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:46.362126 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7afcee6-37be-4ec9-ab2c-8575328e3d7e None admin] PATH_INFO: `/v3/groups/2fbebf9b35d14d719fb2342839d0d025` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:46.372246 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7afcee6-37be-4ec9-ab2c-8575328e3d7e None admin] RBAC: Authorizing `identity:get_group(group_id=2fbebf9b35d14d719fb2342839d0d025)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:46.375214 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7afcee6-37be-4ec9-ab2c-8575328e3d7e None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:46.379439 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 181/381] 10.222.0.15 () {56 vars in 1180 bytes} [Sun Sep 18 00:42:46 2022] GET /identity/v3/groups/2fbebf9b35d14d719fb2342839d0d025 => generated 229 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:46.389825 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736fb6aa-d293-4ec6-bc75-fd3398ad8c0c None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:46.419755 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7afcee6-37be-4ec9-ab2c-8575328e3d7e None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:46.529819 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736fb6aa-d293-4ec6-bc75-fd3398ad8c0c None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:46.578813 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa43fc-4139-461a-8bd9-ed0be0698a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:46.579353 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa43fc-4139-461a-8bd9-ed0be0698a14 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:46.579633 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa43fc-4139-461a-8bd9-ed0be0698a14 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:46.579932 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa43fc-4139-461a-8bd9-ed0be0698a14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:46.580681 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa43fc-4139-461a-8bd9-ed0be0698a14 None admin] RBAC: Adding query filter params (group.id=2fbebf9b35d14d719fb2342839d0d025, role.id=591d4711dc204cf98003c8b7d7558506, scope.project.id=59ffbd91d29d4939bf7137c10c138592) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:42:46.580992 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa43fc-4139-461a-8bd9-ed0be0698a14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:46.582528 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa43fc-4139-461a-8bd9-ed0be0698a14 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:46.599397 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 201/382] 10.222.0.15 () {56 vars in 1376 bytes} [Sun Sep 18 00:42:46 2022] GET /identity/v3/role_assignments?group.id=2fbebf9b35d14d719fb2342839d0d025&scope.project.id=59ffbd91d29d4939bf7137c10c138592&role.id=591d4711dc204cf98003c8b7d7558506 => generated 260 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:46.621062 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:46.630764 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7afcee6-37be-4ec9-ab2c-8575328e3d7e None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:46.679482 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543ed28-cd7d-4b64-89e6-2d87af0e1aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:46.680187 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543ed28-cd7d-4b64-89e6-2d87af0e1aed None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:46.680474 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543ed28-cd7d-4b64-89e6-2d87af0e1aed None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:46.680750 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543ed28-cd7d-4b64-89e6-2d87af0e1aed None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:46.698806 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d543ed28-cd7d-4b64-89e6-2d87af0e1aed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:42:46.708272 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-d543ed28-cd7d-4b64-89e6-2d87af0e1aed None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 18 00:42:46.708272 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:42:46.708272 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:42:46.708272 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:42:46.708272 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:42:46.708272 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:42:46.708272 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:42:46.708272 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:42:46.708272 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:42:46.708272 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:42:46.708272 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:42:46.708272 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:42:46.708272 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:42:46.708272 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:42:46.708272 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:42:46.708272 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:42:46.710069 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:42:46.710069 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:42:46.710069 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:42:46.710069 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:42:46.710069 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:42:46.710069 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:42:46.710069 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:42:46.710069 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:42:46.710069 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:42:46.710069 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:42:46.710069 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:42:46.710069 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:42:46.710069 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:42:46.710069 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:42:46.710069 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:42:46.710069 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:42:46.713255 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:42:46.713255 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:42:46.713255 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:42:46.713255 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:42:46.713255 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:42:46.713255 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:42:46.713255 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:42:46.713255 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:42:46.713255 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:42:46.713255 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:42:46.713255 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 18 00:42:46.713255 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:42:46.713255 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 182/383] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Sep 18 00:42:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:42:46.717300 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa43fc-4139-461a-8bd9-ed0be0698a14 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:46.823288 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:46.948923 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1513a-18eb-475d-8948-a088629103e7 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:46.949707 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1513a-18eb-475d-8948-a088629103e7 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:46.949707 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1513a-18eb-475d-8948-a088629103e7 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:46.951321 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 183/384] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:42:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:42:46.957057 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26148f3-ae7a-47d8-95ea-dd6477f4027e None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:46.957874 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26148f3-ae7a-47d8-95ea-dd6477f4027e None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:46.958725 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26148f3-ae7a-47d8-95ea-dd6477f4027e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:46.967555 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa43fc-4139-461a-8bd9-ed0be0698a14 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:47.000498 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-d26148f3-ae7a-47d8-95ea-dd6477f4027e None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:42:47.001714 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-d26148f3-ae7a-47d8-95ea-dd6477f4027e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:42:47.021995 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fadf3c-c04f-43c5-a8aa-5acd55c36f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:47.022652 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fadf3c-c04f-43c5-a8aa-5acd55c36f2a None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:47.022933 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fadf3c-c04f-43c5-a8aa-5acd55c36f2a None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:47.023211 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fadf3c-c04f-43c5-a8aa-5acd55c36f2a None admin] PATH_INFO: `/v3/roles` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:47.023974 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fadf3c-c04f-43c5-a8aa-5acd55c36f2a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:42:47.024259 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fadf3c-c04f-43c5-a8aa-5acd55c36f2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:47.026601 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fadf3c-c04f-43c5-a8aa-5acd55c36f2a None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:47.044257 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 202/385] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Sep 18 00:42:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:47.046313 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fadf3c-c04f-43c5-a8aa-5acd55c36f2a None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:47.184395 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 184/386] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:42:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 18 00:42:47.248782 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fadf3c-c04f-43c5-a8aa-5acd55c36f2a None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:47.268325 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:47.297643 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805140f3-575c-4172-8f27-4d50904a708a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:47.298305 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805140f3-575c-4172-8f27-4d50904a708a None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:47.298588 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805140f3-575c-4172-8f27-4d50904a708a None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:47.298858 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805140f3-575c-4172-8f27-4d50904a708a None admin] PATH_INFO: `/v3/groups/15caa6296a0b49ebb84ae27cf4744cfc` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:47.304682 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805140f3-575c-4172-8f27-4d50904a708a None admin] RBAC: Authorizing `identity:get_group(group_id=15caa6296a0b49ebb84ae27cf4744cfc)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:47.306189 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805140f3-575c-4172-8f27-4d50904a708a None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:47.308390 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 203/387] 10.222.0.15 () {56 vars in 1180 bytes} [Sun Sep 18 00:42:47 2022] GET /identity/v3/groups/15caa6296a0b49ebb84ae27cf4744cfc => generated 226 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:47.314082 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26148f3-ae7a-47d8-95ea-dd6477f4027e None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:47.437710 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:47.459094 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26148f3-ae7a-47d8-95ea-dd6477f4027e None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:47.514960 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc53a50-4d43-4eba-8a30-2836f9c300f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:47.515830 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc53a50-4d43-4eba-8a30-2836f9c300f0 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:47.516280 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc53a50-4d43-4eba-8a30-2836f9c300f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:47.516703 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc53a50-4d43-4eba-8a30-2836f9c300f0 None admin] PATH_INFO: `/v3/projects/71680fa1985e4fc4a5c1a73f87753f66` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:47.520052 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc53a50-4d43-4eba-8a30-2836f9c300f0 None admin] RBAC: Authorizing `identity:get_project(project_id=71680fa1985e4fc4a5c1a73f87753f66)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:47.522327 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc53a50-4d43-4eba-8a30-2836f9c300f0 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:47.525332 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 185/388] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Sep 18 00:42:47 2022] GET /identity/v3/projects/71680fa1985e4fc4a5c1a73f87753f66 => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:47.532195 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805140f3-575c-4172-8f27-4d50904a708a None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:47.719365 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805140f3-575c-4172-8f27-4d50904a708a None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:47.752402 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc53a50-4d43-4eba-8a30-2836f9c300f0 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:47.782874 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e4a54-ac4f-4f9b-a0fe-2c985f6b85cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:47.783499 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e4a54-ac4f-4f9b-a0fe-2c985f6b85cb None admin] REQUEST_METHOD: `PUT` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:47.783787 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e4a54-ac4f-4f9b-a0fe-2c985f6b85cb None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:47.784089 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e4a54-ac4f-4f9b-a0fe-2c985f6b85cb None admin] PATH_INFO: `/v3/projects/71680fa1985e4fc4a5c1a73f87753f66/groups/15caa6296a0b49ebb84ae27cf4744cfc/roles/e2a7bd363c424c5380514254ad1cc522` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:47.790128 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808e4a54-ac4f-4f9b-a0fe-2c985f6b85cb None admin] RBAC: Authorizing `identity:create_grant(project_id=71680fa1985e4fc4a5c1a73f87753f66, group_id=15caa6296a0b49ebb84ae27cf4744cfc, role_id=e2a7bd363c424c5380514254ad1cc522)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:47.792558 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808e4a54-ac4f-4f9b-a0fe-2c985f6b85cb None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:47.823927 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 204/389] 10.222.0.15 () {58 vars in 1442 bytes} [Sun Sep 18 00:42:47 2022] PUT /identity/v3/projects/71680fa1985e4fc4a5c1a73f87753f66/groups/15caa6296a0b49ebb84ae27cf4744cfc/roles/e2a7bd363c424c5380514254ad1cc522 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 18 00:42:47.932892 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc53a50-4d43-4eba-8a30-2836f9c300f0 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:47.996375 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804eceb-43f9-4ed7-a487-7fe912164a26 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:47.997333 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804eceb-43f9-4ed7-a487-7fe912164a26 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:47.998058 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804eceb-43f9-4ed7-a487-7fe912164a26 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:47.999846 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 205/390] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:42:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 18 00:42:48.005042 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72224ed2-9d7e-47b9-b684-e63d72acf9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:48.007522 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941958c-a942-40a4-ab91-a73de732ae16 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:48.009076 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941958c-a942-40a4-ab91-a73de732ae16 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:48.009602 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941958c-a942-40a4-ab91-a73de732ae16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:48.010549 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72224ed2-9d7e-47b9-b684-e63d72acf9b2 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:48.011051 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72224ed2-9d7e-47b9-b684-e63d72acf9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:48.011495 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72224ed2-9d7e-47b9-b684-e63d72acf9b2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:48.047211 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72224ed2-9d7e-47b9-b684-e63d72acf9b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:42:48.050671 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-b941958c-a942-40a4-ab91-a73de732ae16 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:42:48.052345 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-b941958c-a942-40a4-ab91-a73de732ae16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:42:48.059037 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-72224ed2-9d7e-47b9-b684-e63d72acf9b2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 18 00:42:48.059037 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:42:48.059037 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:42:48.059037 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:42:48.059037 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:42:48.059037 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:42:48.059037 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:42:48.059037 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:42:48.059037 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:42:48.059037 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:42:48.059037 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:42:48.059037 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:42:48.059037 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:42:48.059037 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:42:48.059037 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:42:48.059037 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:42:48.060000 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:42:48.060000 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:42:48.060000 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:42:48.060000 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:42:48.060000 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:42:48.060000 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:42:48.060000 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:42:48.060000 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:42:48.060000 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:42:48.060000 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:42:48.060000 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:42:48.060000 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:42:48.060000 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:42:48.060000 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:42:48.060000 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:42:48.060000 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:42:48.060815 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:42:48.060815 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:42:48.060815 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:42:48.060815 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:42:48.060815 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:42:48.060815 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:42:48.060815 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:42:48.060815 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:42:48.060815 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:42:48.060815 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:42:48.060815 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 18 00:42:48.060815 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:42:48.065729 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 186/391] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Sep 18 00:42:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:42:48.081152 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72224ed2-9d7e-47b9-b684-e63d72acf9b2 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:48.095668 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:48.144464 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:48.150097 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 206/392] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:42:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 18 00:42:48.292993 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72224ed2-9d7e-47b9-b684-e63d72acf9b2 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:48.351574 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6475ee-06ab-4bba-8027-b7286ab44549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:48.353156 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6475ee-06ab-4bba-8027-b7286ab44549 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:48.353963 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6475ee-06ab-4bba-8027-b7286ab44549 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:48.354730 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6475ee-06ab-4bba-8027-b7286ab44549 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:48.356294 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6475ee-06ab-4bba-8027-b7286ab44549 None admin] RBAC: Adding query filter params (name=member) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:42:48.357124 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6475ee-06ab-4bba-8027-b7286ab44549 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:48.360047 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6475ee-06ab-4bba-8027-b7286ab44549 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:48.384968 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 187/393] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Sep 18 00:42:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:48.392290 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b941958c-a942-40a4-ab91-a73de732ae16 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:48.547939 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6475ee-06ab-4bba-8027-b7286ab44549 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:48.563936 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b941958c-a942-40a4-ab91-a73de732ae16 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:48.632029 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89b6333-c729-4047-89c2-1713a0c6f1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:48.632029 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b6333-c729-4047-89c2-1713a0c6f1c3 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:48.632029 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b6333-c729-4047-89c2-1713a0c6f1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:48.632029 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b6333-c729-4047-89c2-1713a0c6f1c3 None admin] PATH_INFO: `/v3/groups/15caa6296a0b49ebb84ae27cf4744cfc` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:48.632631 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89b6333-c729-4047-89c2-1713a0c6f1c3 None admin] RBAC: Authorizing `identity:get_group(group_id=15caa6296a0b49ebb84ae27cf4744cfc)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:48.633348 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89b6333-c729-4047-89c2-1713a0c6f1c3 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:48.635571 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 207/394] 10.222.0.15 () {56 vars in 1180 bytes} [Sun Sep 18 00:42:48 2022] GET /identity/v3/groups/15caa6296a0b49ebb84ae27cf4744cfc => generated 226 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:48.641345 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89b6333-c729-4047-89c2-1713a0c6f1c3 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:48.700536 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:48.755681 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:48.803064 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89b6333-c729-4047-89c2-1713a0c6f1c3 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:48.808538 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6475ee-06ab-4bba-8027-b7286ab44549 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:48.845886 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a61bd-d5e8-49e1-9257-7275888ec834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:48.846603 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a61bd-d5e8-49e1-9257-7275888ec834 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:48.846893 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a61bd-d5e8-49e1-9257-7275888ec834 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:48.847172 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a61bd-d5e8-49e1-9257-7275888ec834 None admin] PATH_INFO: `/v3/projects/71680fa1985e4fc4a5c1a73f87753f66` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:48.848993 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991a61bd-d5e8-49e1-9257-7275888ec834 None admin] RBAC: Authorizing `identity:get_project(project_id=71680fa1985e4fc4a5c1a73f87753f66)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:48.850496 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991a61bd-d5e8-49e1-9257-7275888ec834 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:48.852656 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 208/395] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Sep 18 00:42:48 2022] GET /identity/v3/projects/71680fa1985e4fc4a5c1a73f87753f66 => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:42:48.858565 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a61bd-d5e8-49e1-9257-7275888ec834 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:48.956749 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb5d311-a943-4a35-b07a-b62642801b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:48.958017 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5d311-a943-4a35-b07a-b62642801b5d None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:48.958304 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5d311-a943-4a35-b07a-b62642801b5d None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:48.958587 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5d311-a943-4a35-b07a-b62642801b5d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:48.985481 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb5d311-a943-4a35-b07a-b62642801b5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:42:48.991497 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:48.997844 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-deb5d311-a943-4a35-b07a-b62642801b5d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 18 00:42:48.997844 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:42:48.997844 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:42:48.997844 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:42:48.997844 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:42:48.997844 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:42:48.997844 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:42:48.997844 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:42:48.997844 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:42:48.997844 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:42:48.997844 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:42:48.997844 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:42:48.997844 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:42:48.997844 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:42:48.997844 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:42:48.997844 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:42:48.999412 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:42:48.999412 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:42:48.999412 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:42:48.999412 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:42:48.999412 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:42:48.999412 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:42:48.999412 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:42:48.999412 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:42:48.999412 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:42:48.999412 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:42:48.999412 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:42:48.999412 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:42:48.999412 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:42:48.999412 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:42:48.999412 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:42:48.999412 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:42:49.000926 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:42:49.000926 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:42:49.000926 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:42:49.000926 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:42:49.000926 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:42:49.000926 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:42:49.000926 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:42:49.000926 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:42:49.000926 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:42:49.000926 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:42:49.000926 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 18 00:42:49.000926 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:42:49.002073 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a61bd-d5e8-49e1-9257-7275888ec834 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:49.003562 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 188/396] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Sep 18 00:42:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 456 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:42:49.009573 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb5d311-a943-4a35-b07a-b62642801b5d None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:49.100087 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c9d44-f1ca-48e7-b9be-285ea350907b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:49.105593 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c9d44-f1ca-48e7-b9be-285ea350907b None admin] REQUEST_METHOD: `PUT` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:49.105869 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c9d44-f1ca-48e7-b9be-285ea350907b None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:49.106159 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c9d44-f1ca-48e7-b9be-285ea350907b None admin] PATH_INFO: `/v3/projects/71680fa1985e4fc4a5c1a73f87753f66/groups/15caa6296a0b49ebb84ae27cf4744cfc/roles/59d7218a321b4c20bc1996494a48a2a1` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:49.108549 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c9d44-f1ca-48e7-b9be-285ea350907b None admin] RBAC: Authorizing `identity:create_grant(project_id=71680fa1985e4fc4a5c1a73f87753f66, group_id=15caa6296a0b49ebb84ae27cf4744cfc, role_id=59d7218a321b4c20bc1996494a48a2a1)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:49.110285 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c9d44-f1ca-48e7-b9be-285ea350907b None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:49.136901 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 209/397] 10.222.0.15 () {58 vars in 1442 bytes} [Sun Sep 18 00:42:48 2022] PUT /identity/v3/projects/71680fa1985e4fc4a5c1a73f87753f66/groups/15caa6296a0b49ebb84ae27cf4744cfc/roles/59d7218a321b4c20bc1996494a48a2a1 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 18 00:42:49.206151 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb5d311-a943-4a35-b07a-b62642801b5d None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:49.259769 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b1b65e-806d-4c2e-a73a-a8e97782f7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:49.260482 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b1b65e-806d-4c2e-a73a-a8e97782f7a5 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:49.260766 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b1b65e-806d-4c2e-a73a-a8e97782f7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:49.261043 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b1b65e-806d-4c2e-a73a-a8e97782f7a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:49.261770 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b1b65e-806d-4c2e-a73a-a8e97782f7a5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:42:49.262075 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b1b65e-806d-4c2e-a73a-a8e97782f7a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:49.263675 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b1b65e-806d-4c2e-a73a-a8e97782f7a5 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:49.269279 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:49.279811 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 189/398] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Sep 18 00:42:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:42:49.286090 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c9d44-f1ca-48e7-b9be-285ea350907b None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:49.424143 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c9d44-f1ca-48e7-b9be-285ea350907b None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:49.429948 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34066db1-3646-4f39-8acc-d44f18a0dff5 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:49.430268 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34066db1-3646-4f39-8acc-d44f18a0dff5 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:49.430501 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34066db1-3646-4f39-8acc-d44f18a0dff5 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:49.431985 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 190/399] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:42:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 18 00:42:49.437899 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664fa3f-ebb3-4638-971c-2b3bc71bffa9 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:49.438206 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664fa3f-ebb3-4638-971c-2b3bc71bffa9 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:49.438463 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664fa3f-ebb3-4638-971c-2b3bc71bffa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:49.469412 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa36b46-4ad0-4eba-9900-74b3a00bcd31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:49.470089 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa36b46-4ad0-4eba-9900-74b3a00bcd31 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:49.470376 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa36b46-4ad0-4eba-9900-74b3a00bcd31 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:49.470656 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa36b46-4ad0-4eba-9900-74b3a00bcd31 None admin] PATH_INFO: `/v3/groups/15caa6296a0b49ebb84ae27cf4744cfc` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:49.471954 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa36b46-4ad0-4eba-9900-74b3a00bcd31 None admin] RBAC: Authorizing `identity:get_group(group_id=15caa6296a0b49ebb84ae27cf4744cfc)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:49.474338 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa36b46-4ad0-4eba-9900-74b3a00bcd31 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:49.476472 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 210/400] 10.222.0.15 () {56 vars in 1180 bytes} [Sun Sep 18 00:42:49 2022] GET /identity/v3/groups/15caa6296a0b49ebb84ae27cf4744cfc => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:49.481509 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-c664fa3f-ebb3-4638-971c-2b3bc71bffa9 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:42:49.482754 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-c664fa3f-ebb3-4638-971c-2b3bc71bffa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:42:49.489068 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa36b46-4ad0-4eba-9900-74b3a00bcd31 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:49.540217 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:49.594486 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 191/401] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:42:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 00:42:49.646428 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa36b46-4ad0-4eba-9900-74b3a00bcd31 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:49.686583 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c26b9-7278-43f6-9aea-b20f653471c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:49.687592 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c26b9-7278-43f6-9aea-b20f653471c8 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:49.688138 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c26b9-7278-43f6-9aea-b20f653471c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:49.688593 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c26b9-7278-43f6-9aea-b20f653471c8 None admin] PATH_INFO: `/v3/projects/14cc5534b3054dfbbc19e546f4d51538` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:49.690131 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054c26b9-7278-43f6-9aea-b20f653471c8 None admin] RBAC: Authorizing `identity:get_project(project_id=14cc5534b3054dfbbc19e546f4d51538)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:49.692448 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054c26b9-7278-43f6-9aea-b20f653471c8 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:49.694886 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 211/402] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Sep 18 00:42:49 2022] GET /identity/v3/projects/14cc5534b3054dfbbc19e546f4d51538 => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:42:49.701117 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664fa3f-ebb3-4638-971c-2b3bc71bffa9 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:49.859846 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664fa3f-ebb3-4638-971c-2b3bc71bffa9 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:49.900647 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:49.911174 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b75cd7-0f3e-4ca0-a99e-4d7160261531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:49.911866 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b75cd7-0f3e-4ca0-a99e-4d7160261531 None admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:49.912170 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b75cd7-0f3e-4ca0-a99e-4d7160261531 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:49.912446 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b75cd7-0f3e-4ca0-a99e-4d7160261531 None admin] PATH_INFO: `/v3/projects/14cc5534b3054dfbbc19e546f4d51538/groups/15caa6296a0b49ebb84ae27cf4744cfc/roles/59d7218a321b4c20bc1996494a48a2a1` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:49.917739 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b75cd7-0f3e-4ca0-a99e-4d7160261531 None admin] RBAC: Authorizing `identity:create_grant(project_id=14cc5534b3054dfbbc19e546f4d51538, group_id=15caa6296a0b49ebb84ae27cf4744cfc, role_id=59d7218a321b4c20bc1996494a48a2a1)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:49.919221 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b75cd7-0f3e-4ca0-a99e-4d7160261531 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:49.940846 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 192/403] 10.222.0.15 () {58 vars in 1442 bytes} [Sun Sep 18 00:42:49 2022] PUT /identity/v3/projects/14cc5534b3054dfbbc19e546f4d51538/groups/15caa6296a0b49ebb84ae27cf4744cfc/roles/59d7218a321b4c20bc1996494a48a2a1 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 00:42:49.950487 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c26b9-7278-43f6-9aea-b20f653471c8 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:50.063528 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad221c-32b9-4184-927e-c72c49da7803 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:50.064069 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad221c-32b9-4184-927e-c72c49da7803 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:50.064143 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad221c-32b9-4184-927e-c72c49da7803 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:50.065688 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 193/404] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:42:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:42:50.073729 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d10c2-fa31-4fe7-b106-92b17c0a5ba1 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:50.074485 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d10c2-fa31-4fe7-b106-92b17c0a5ba1 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:50.074968 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d10c2-fa31-4fe7-b106-92b17c0a5ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:50.106245 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-c46d10c2-fa31-4fe7-b106-92b17c0a5ba1 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:42:50.106909 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:50.107469 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-c46d10c2-fa31-4fe7-b106-92b17c0a5ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:42:50.112968 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c26b9-7278-43f6-9aea-b20f653471c8 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:50.163960 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15532a55-4a52-4853-aca0-b1b39c7d773b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:50.164625 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15532a55-4a52-4853-aca0-b1b39c7d773b None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:50.164914 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15532a55-4a52-4853-aca0-b1b39c7d773b None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:50.165194 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15532a55-4a52-4853-aca0-b1b39c7d773b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:50.183940 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15532a55-4a52-4853-aca0-b1b39c7d773b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:42:50.186806 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-15532a55-4a52-4853-aca0-b1b39c7d773b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 18 00:42:50.186806 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:42:50.186806 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:42:50.186806 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:42:50.186806 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:42:50.186806 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:42:50.186806 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:42:50.186806 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:42:50.186806 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:42:50.186806 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:42:50.186806 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:42:50.186806 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:42:50.186806 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:42:50.186806 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:42:50.186806 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:42:50.186806 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:42:50.187766 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:42:50.187766 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:42:50.187766 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:42:50.187766 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:42:50.187766 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:42:50.187766 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:42:50.187766 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:42:50.187766 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:42:50.187766 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:42:50.187766 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:42:50.187766 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:42:50.187766 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:42:50.187766 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:42:50.187766 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:42:50.187766 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:42:50.187766 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:42:50.188615 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:42:50.188615 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:42:50.188615 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:42:50.188615 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:42:50.188615 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:42:50.188615 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:42:50.188615 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:42:50.188615 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:42:50.188615 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:42:50.188615 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:42:50.188615 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 18 00:42:50.188615 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:42:50.194182 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 212/405] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Sep 18 00:42:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:42:50.195246 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15532a55-4a52-4853-aca0-b1b39c7d773b None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:50.256099 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 194/406] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:42:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 00:42:50.319713 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15532a55-4a52-4853-aca0-b1b39c7d773b None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:50.361950 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787136f1-d80a-47ff-a660-15fd1430b2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:50.362577 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787136f1-d80a-47ff-a660-15fd1430b2ea None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:50.362859 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787136f1-d80a-47ff-a660-15fd1430b2ea None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:50.363186 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787136f1-d80a-47ff-a660-15fd1430b2ea None admin] PATH_INFO: `/v3/roles` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:50.363852 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787136f1-d80a-47ff-a660-15fd1430b2ea None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:42:50.364192 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787136f1-d80a-47ff-a660-15fd1430b2ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:50.365594 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787136f1-d80a-47ff-a660-15fd1430b2ea None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:50.380084 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 213/407] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Sep 18 00:42:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:42:50.383283 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46d10c2-fa31-4fe7-b106-92b17c0a5ba1 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:50.547487 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46d10c2-fa31-4fe7-b106-92b17c0a5ba1 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:50.576859 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:50.597716 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787136f1-d80a-47ff-a660-15fd1430b2ea None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:50.601543 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad3410-923d-46fc-ba87-8fc36a6d9094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:50.602497 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad3410-923d-46fc-ba87-8fc36a6d9094 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:50.602985 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad3410-923d-46fc-ba87-8fc36a6d9094 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:50.603461 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad3410-923d-46fc-ba87-8fc36a6d9094 None admin] PATH_INFO: `/v3/groups/15caa6296a0b49ebb84ae27cf4744cfc` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:50.604967 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bad3410-923d-46fc-ba87-8fc36a6d9094 None admin] RBAC: Authorizing `identity:get_group(group_id=15caa6296a0b49ebb84ae27cf4744cfc)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:50.607031 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bad3410-923d-46fc-ba87-8fc36a6d9094 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:50.609267 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 195/408] 10.222.0.15 () {56 vars in 1180 bytes} [Sun Sep 18 00:42:50 2022] GET /identity/v3/groups/15caa6296a0b49ebb84ae27cf4744cfc => generated 226 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:50.617080 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad3410-923d-46fc-ba87-8fc36a6d9094 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:50.650972 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:50.791246 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad3410-923d-46fc-ba87-8fc36a6d9094 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:50.800021 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787136f1-d80a-47ff-a660-15fd1430b2ea None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:50.831384 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c403f21-ffb3-4685-9e26-60b5f6030ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:50.832056 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c403f21-ffb3-4685-9e26-60b5f6030ea8 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:50.832341 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c403f21-ffb3-4685-9e26-60b5f6030ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:50.832617 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c403f21-ffb3-4685-9e26-60b5f6030ea8 None admin] PATH_INFO: `/v3/projects/14cc5534b3054dfbbc19e546f4d51538` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:50.833767 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c403f21-ffb3-4685-9e26-60b5f6030ea8 None admin] RBAC: Authorizing `identity:get_project(project_id=14cc5534b3054dfbbc19e546f4d51538)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:50.835236 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c403f21-ffb3-4685-9e26-60b5f6030ea8 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:50.837353 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 196/409] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Sep 18 00:42:50 2022] GET /identity/v3/projects/14cc5534b3054dfbbc19e546f4d51538 => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:50.838717 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e053b-c90e-42c0-9a1b-ac3d528a2ead None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:50.838998 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e053b-c90e-42c0-9a1b-ac3d528a2ead None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:50.839294 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e053b-c90e-42c0-9a1b-ac3d528a2ead None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:50.842960 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bdfab5-8691-4058-931d-a087be765084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:50.843915 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bdfab5-8691-4058-931d-a087be765084 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:50.844130 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 197/410] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:42:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:42:50.844624 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bdfab5-8691-4058-931d-a087be765084 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:50.844997 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e053b-c90e-42c0-9a1b-ac3d528a2ead None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:50.845410 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bdfab5-8691-4058-931d-a087be765084 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:50.857704 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bdfab5-8691-4058-931d-a087be765084 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:42:50.864042 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-78bdfab5-8691-4058-931d-a087be765084 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 00:42:50.864042 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:42:50.864042 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:42:50.864042 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:42:50.864042 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:42:50.864042 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:42:50.864042 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:42:50.864042 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:42:50.864042 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:42:50.864042 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:42:50.864042 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:42:50.864042 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:42:50.864042 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:42:50.864042 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:42:50.864042 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:42:50.864042 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:42:50.865012 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:42:50.865012 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:42:50.865012 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:42:50.865012 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:42:50.865012 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:42:50.865012 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:42:50.865012 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:42:50.865012 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:42:50.865012 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:42:50.865012 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:42:50.865012 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:42:50.865012 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:42:50.865012 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:42:50.865012 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:42:50.865012 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:42:50.865012 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:42:50.865885 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:42:50.865885 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:42:50.865885 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:42:50.865885 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:42:50.865885 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:42:50.865885 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:42:50.865885 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:42:50.865885 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:42:50.865885 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:42:50.865885 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:42:50.865885 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 00:42:50.865885 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:42:50.868621 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 214/411] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Sep 18 00:42:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:42:50.875045 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddfe301-6681-4a8f-b922-3cdc0303e913 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:50.875628 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddfe301-6681-4a8f-b922-3cdc0303e913 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:50.876144 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddfe301-6681-4a8f-b922-3cdc0303e913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:50.897153 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-fddfe301-6681-4a8f-b922-3cdc0303e913 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:42:50.898770 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-fddfe301-6681-4a8f-b922-3cdc0303e913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:42:50.909639 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:50.975607 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e053b-c90e-42c0-9a1b-ac3d528a2ead None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:50.976819 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 215/412] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:42:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 00:42:50.977946 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddfe301-6681-4a8f-b922-3cdc0303e913 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:50.989170 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:51.018946 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb2dd4-64d6-4546-82b1-bc87ea20631d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:51.020079 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb2dd4-64d6-4546-82b1-bc87ea20631d None admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:51.020514 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb2dd4-64d6-4546-82b1-bc87ea20631d None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:51.020980 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb2dd4-64d6-4546-82b1-bc87ea20631d None admin] PATH_INFO: `/v3/projects/14cc5534b3054dfbbc19e546f4d51538/groups/15caa6296a0b49ebb84ae27cf4744cfc/roles/e2a7bd363c424c5380514254ad1cc522` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:51.023580 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fb2dd4-64d6-4546-82b1-bc87ea20631d None admin] RBAC: Authorizing `identity:create_grant(project_id=14cc5534b3054dfbbc19e546f4d51538, group_id=15caa6296a0b49ebb84ae27cf4744cfc, role_id=e2a7bd363c424c5380514254ad1cc522)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:51.026091 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fb2dd4-64d6-4546-82b1-bc87ea20631d None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:51.048057 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 198/413] 10.222.0.15 () {58 vars in 1442 bytes} [Sun Sep 18 00:42:50 2022] PUT /identity/v3/projects/14cc5534b3054dfbbc19e546f4d51538/groups/15caa6296a0b49ebb84ae27cf4744cfc/roles/e2a7bd363c424c5380514254ad1cc522 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 00:42:51.146863 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddfe301-6681-4a8f-b922-3cdc0303e913 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:51.201638 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7041833-b425-4d57-ade8-782681170e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:51.202261 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7041833-b425-4d57-ade8-782681170e96 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:51.202537 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7041833-b425-4d57-ade8-782681170e96 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:51.202831 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7041833-b425-4d57-ade8-782681170e96 None admin] PATH_INFO: `/v3/roles` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:51.203498 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7041833-b425-4d57-ade8-782681170e96 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:42:51.203803 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7041833-b425-4d57-ade8-782681170e96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:51.205255 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7041833-b425-4d57-ade8-782681170e96 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:51.220534 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 216/414] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Sep 18 00:42:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:51.226775 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb2dd4-64d6-4546-82b1-bc87ea20631d None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:51.366621 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb2dd4-64d6-4546-82b1-bc87ea20631d None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:51.382489 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:51.407674 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf291d-0829-4c4a-9dcf-ade413ad2911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:51.408737 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf291d-0829-4c4a-9dcf-ade413ad2911 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:51.409212 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf291d-0829-4c4a-9dcf-ade413ad2911 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:51.409647 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf291d-0829-4c4a-9dcf-ade413ad2911 None admin] PATH_INFO: `/v3/groups/2fbebf9b35d14d719fb2342839d0d025` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:51.411058 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcf291d-0829-4c4a-9dcf-ade413ad2911 None admin] RBAC: Authorizing `identity:get_group(group_id=2fbebf9b35d14d719fb2342839d0d025)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:51.412805 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcf291d-0829-4c4a-9dcf-ade413ad2911 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:51.415118 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 199/415] 10.222.0.15 () {56 vars in 1180 bytes} [Sun Sep 18 00:42:51 2022] GET /identity/v3/groups/2fbebf9b35d14d719fb2342839d0d025 => generated 229 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:51.416471 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7041833-b425-4d57-ade8-782681170e96 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:51.420519 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf291d-0829-4c4a-9dcf-ade413ad2911 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:51.572294 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:51.588774 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf291d-0829-4c4a-9dcf-ade413ad2911 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:51.602243 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7041833-b425-4d57-ade8-782681170e96 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:51.641540 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a0572-fba0-4166-9111-c96bcb725eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:51.642583 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a0572-fba0-4166-9111-c96bcb725eda None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:51.643068 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a0572-fba0-4166-9111-c96bcb725eda None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:51.644234 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a0572-fba0-4166-9111-c96bcb725eda None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:51.664892 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04a3ca-9aa0-4c13-94ab-42e05f48d7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:51.665876 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04a3ca-9aa0-4c13-94ab-42e05f48d7a1 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:51.666358 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04a3ca-9aa0-4c13-94ab-42e05f48d7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:51.667088 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04a3ca-9aa0-4c13-94ab-42e05f48d7a1 None admin] PATH_INFO: `/v3/projects/59ffbd91d29d4939bf7137c10c138592` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:51.668490 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201a0572-fba0-4166-9111-c96bcb725eda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:42:51.669346 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee04a3ca-9aa0-4c13-94ab-42e05f48d7a1 None admin] RBAC: Authorizing `identity:get_project(project_id=59ffbd91d29d4939bf7137c10c138592)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:51.675057 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-201a0572-fba0-4166-9111-c96bcb725eda None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 18 00:42:51.675057 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:42:51.675057 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:42:51.675057 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:42:51.675057 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:42:51.675057 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:42:51.675057 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:42:51.675057 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:42:51.675057 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:42:51.675057 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:42:51.675057 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:42:51.675057 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:42:51.675057 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:42:51.675057 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:42:51.675057 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:42:51.675057 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:42:51.676578 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:42:51.676578 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:42:51.676578 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:42:51.676578 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:42:51.676578 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:42:51.676578 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:42:51.676578 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:42:51.676578 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:42:51.676578 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:42:51.676578 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:42:51.676578 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:42:51.676578 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:42:51.676578 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:42:51.676578 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:42:51.676578 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:42:51.676578 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:42:51.677370 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:42:51.677370 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:42:51.677370 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:42:51.677370 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:42:51.677370 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:42:51.677370 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:42:51.677370 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:42:51.677370 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:42:51.677370 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:42:51.677370 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:42:51.677370 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 18 00:42:51.677370 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:42:51.677981 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee04a3ca-9aa0-4c13-94ab-42e05f48d7a1 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:51.679945 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 200/416] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Sep 18 00:42:51 2022] GET /identity/v3/projects/59ffbd91d29d4939bf7137c10c138592 => generated 344 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:42:51.680663 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 217/417] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Sep 18 00:42:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 00:42:51.688913 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04a3ca-9aa0-4c13-94ab-42e05f48d7a1 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:51.689093 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a0572-fba0-4166-9111-c96bcb725eda None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:51.800941 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:51.871632 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04a3ca-9aa0-4c13-94ab-42e05f48d7a1 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:51.908157 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a0572-fba0-4166-9111-c96bcb725eda None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:51.914530 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ad2f5f-9252-41c4-85fc-ccbd68abf763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:51.915284 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad2f5f-9252-41c4-85fc-ccbd68abf763 None admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:51.915508 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad2f5f-9252-41c4-85fc-ccbd68abf763 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:51.915786 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad2f5f-9252-41c4-85fc-ccbd68abf763 None admin] PATH_INFO: `/v3/projects/59ffbd91d29d4939bf7137c10c138592/groups/2fbebf9b35d14d719fb2342839d0d025/roles/591d4711dc204cf98003c8b7d7558506` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:51.919431 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ad2f5f-9252-41c4-85fc-ccbd68abf763 None admin] RBAC: Authorizing `identity:create_grant(project_id=59ffbd91d29d4939bf7137c10c138592, group_id=2fbebf9b35d14d719fb2342839d0d025, role_id=591d4711dc204cf98003c8b7d7558506)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:51.920974 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ad2f5f-9252-41c4-85fc-ccbd68abf763 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:51.951162 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 201/418] 10.222.0.15 () {58 vars in 1442 bytes} [Sun Sep 18 00:42:51 2022] PUT /identity/v3/projects/59ffbd91d29d4939bf7137c10c138592/groups/2fbebf9b35d14d719fb2342839d0d025/roles/591d4711dc204cf98003c8b7d7558506 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 00:42:51.966504 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:51.974233 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112d672b-abe5-4b65-891d-a194ba27f2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:51.974878 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d672b-abe5-4b65-891d-a194ba27f2d5 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:51.975160 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d672b-abe5-4b65-891d-a194ba27f2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:51.975433 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d672b-abe5-4b65-891d-a194ba27f2d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:51.976238 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112d672b-abe5-4b65-891d-a194ba27f2d5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:42:51.976544 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112d672b-abe5-4b65-891d-a194ba27f2d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:51.977963 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112d672b-abe5-4b65-891d-a194ba27f2d5 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:51.992401 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 218/419] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Sep 18 00:42:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:51.995436 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ad2f5f-9252-41c4-85fc-ccbd68abf763 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:52.143223 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ad2f5f-9252-41c4-85fc-ccbd68abf763 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:52.162077 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:52.195503 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1767a2f-b820-4a1f-864b-6985a7688198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:52.196073 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1767a2f-b820-4a1f-864b-6985a7688198 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:52.196595 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1767a2f-b820-4a1f-864b-6985a7688198 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:52.197073 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1767a2f-b820-4a1f-864b-6985a7688198 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:52.295545 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1767a2f-b820-4a1f-864b-6985a7688198 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:52.299059 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d21d13-bf6e-4a25-9c41-847418880405 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:52.300044 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d21d13-bf6e-4a25-9c41-847418880405 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:52.300529 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d21d13-bf6e-4a25-9c41-847418880405 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:52.303091 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 219/420] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:42:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:42:52.304312 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1767a2f-b820-4a1f-864b-6985a7688198 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:52.309084 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3c953-6aa4-4950-9475-17b07c6f9cbf None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:52.309084 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3c953-6aa4-4950-9475-17b07c6f9cbf None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:52.309357 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3c953-6aa4-4950-9475-17b07c6f9cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:52.335184 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-8da3c953-6aa4-4950-9475-17b07c6f9cbf None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:42:52.335638 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-8da3c953-6aa4-4950-9475-17b07c6f9cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:42:52.491271 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 202/421] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Sep 18 00:42:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 00:42:52.497790 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1767a2f-b820-4a1f-864b-6985a7688198 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:52.502611 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 220/422] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:42:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 00:42:52.526613 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:52.679815 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1767a2f-b820-4a1f-864b-6985a7688198 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:52.750266 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f544f64f-64fe-4331-90d2-85030356c1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:52.751281 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f544f64f-64fe-4331-90d2-85030356c1ab None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:52.751785 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f544f64f-64fe-4331-90d2-85030356c1ab None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:52.752279 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f544f64f-64fe-4331-90d2-85030356c1ab None admin] PATH_INFO: `/v3/projects/71680fa1985e4fc4a5c1a73f87753f66` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:52.754948 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f544f64f-64fe-4331-90d2-85030356c1ab None admin] RBAC: Authorizing `identity:get_project(project_id=71680fa1985e4fc4a5c1a73f87753f66)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:52.757805 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f544f64f-64fe-4331-90d2-85030356c1ab None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:52.761578 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 203/423] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Sep 18 00:42:52 2022] GET /identity/v3/projects/71680fa1985e4fc4a5c1a73f87753f66 => generated 298 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:42:52.769780 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da3c953-6aa4-4950-9475-17b07c6f9cbf None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:52.830816 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb671d8-4ec8-4032-b3cb-98fb53594fe3 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:52.831312 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb671d8-4ec8-4032-b3cb-98fb53594fe3 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:52.832281 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb671d8-4ec8-4032-b3cb-98fb53594fe3 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:52.835059 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 204/424] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:42:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:42:52.841284 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39839c7-a10e-48d0-b306-56a18abad79e None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:52.841764 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39839c7-a10e-48d0-b306-56a18abad79e None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:52.842250 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39839c7-a10e-48d0-b306-56a18abad79e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:52.898638 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da3c953-6aa4-4950-9475-17b07c6f9cbf None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:52.899153 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-a39839c7-a10e-48d0-b306-56a18abad79e None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:42:52.901411 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-a39839c7-a10e-48d0-b306-56a18abad79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:42:52.928687 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:52.944092 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9404be2-1d91-485a-bf1e-cdad93d58a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:52.945081 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9404be2-1d91-485a-bf1e-cdad93d58a09 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:52.945881 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9404be2-1d91-485a-bf1e-cdad93d58a09 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:52.946371 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9404be2-1d91-485a-bf1e-cdad93d58a09 None admin] PATH_INFO: `/v3/groups/15caa6296a0b49ebb84ae27cf4744cfc` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:52.947841 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9404be2-1d91-485a-bf1e-cdad93d58a09 None admin] RBAC: Authorizing `identity:get_group(group_id=15caa6296a0b49ebb84ae27cf4744cfc)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:52.949670 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9404be2-1d91-485a-bf1e-cdad93d58a09 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:52.951836 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 221/425] 10.222.0.15 () {56 vars in 1180 bytes} [Sun Sep 18 00:42:52 2022] GET /identity/v3/groups/15caa6296a0b49ebb84ae27cf4744cfc => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:52.958688 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9404be2-1d91-485a-bf1e-cdad93d58a09 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:53.075377 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9404be2-1d91-485a-bf1e-cdad93d58a09 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:53.117593 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218467a5-75bc-42c5-911f-63b0275bed11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:53.118587 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218467a5-75bc-42c5-911f-63b0275bed11 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:53.119134 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218467a5-75bc-42c5-911f-63b0275bed11 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:53.119632 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218467a5-75bc-42c5-911f-63b0275bed11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:53.120650 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218467a5-75bc-42c5-911f-63b0275bed11 None admin] RBAC: Adding query filter params (group.id=15caa6296a0b49ebb84ae27cf4744cfc, role.id=e2a7bd363c424c5380514254ad1cc522, scope.project.id=71680fa1985e4fc4a5c1a73f87753f66) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:42:53.121195 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218467a5-75bc-42c5-911f-63b0275bed11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:53.123063 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218467a5-75bc-42c5-911f-63b0275bed11 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:53.130620 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 222/426] 10.222.0.15 () {56 vars in 1376 bytes} [Sun Sep 18 00:42:52 2022] GET /identity/v3/role_assignments?group.id=15caa6296a0b49ebb84ae27cf4744cfc&scope.project.id=71680fa1985e4fc4a5c1a73f87753f66&role.id=e2a7bd363c424c5380514254ad1cc522 => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:42:53.146464 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 205/427] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:42:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 18 00:42:53.194421 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218467a5-75bc-42c5-911f-63b0275bed11 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:53.311670 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:53.385260 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218467a5-75bc-42c5-911f-63b0275bed11 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:53.433921 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221fd9ef-7dda-4924-880a-ab9415238373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:53.434574 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221fd9ef-7dda-4924-880a-ab9415238373 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:53.434856 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221fd9ef-7dda-4924-880a-ab9415238373 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:53.435122 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221fd9ef-7dda-4924-880a-ab9415238373 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:53.447835 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221fd9ef-7dda-4924-880a-ab9415238373 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:42:53.453273 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-221fd9ef-7dda-4924-880a-ab9415238373 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 18 00:42:53.453273 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:42:53.453273 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:42:53.453273 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:42:53.453273 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:42:53.453273 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:42:53.453273 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:42:53.453273 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:42:53.453273 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:42:53.453273 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:42:53.453273 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:42:53.453273 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:42:53.453273 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:42:53.453273 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:42:53.453273 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:42:53.453273 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:42:53.454955 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:42:53.454955 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:42:53.454955 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:42:53.454955 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:42:53.454955 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:42:53.454955 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:42:53.454955 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:42:53.454955 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:42:53.454955 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:42:53.454955 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:42:53.454955 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:42:53.454955 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:42:53.454955 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:42:53.454955 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:42:53.454955 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:42:53.454955 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:42:53.457344 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:42:53.457344 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:42:53.457344 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:42:53.457344 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:42:53.457344 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:42:53.457344 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:42:53.457344 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:42:53.457344 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:42:53.457344 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:42:53.457344 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:42:53.457344 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 18 00:42:53.457344 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:42:53.457344 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 223/428] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Sep 18 00:42:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:42:53.461063 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39839c7-a10e-48d0-b306-56a18abad79e None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:53.486673 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:53.617770 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221fd9ef-7dda-4924-880a-ab9415238373 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:53.710531 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39839c7-a10e-48d0-b306-56a18abad79e None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:53.765625 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221fd9ef-7dda-4924-880a-ab9415238373 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:53.766395 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42d473d-0615-4c71-ae7c-89e164d1635d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:53.767307 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d473d-0615-4c71-ae7c-89e164d1635d None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:53.767595 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d473d-0615-4c71-ae7c-89e164d1635d None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:53.767870 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d473d-0615-4c71-ae7c-89e164d1635d None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:53.770091 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42d473d-0615-4c71-ae7c-89e164d1635d None admin] RBAC: Adding query filter params (name=member) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:42:53.770396 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42d473d-0615-4c71-ae7c-89e164d1635d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:53.771796 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42d473d-0615-4c71-ae7c-89e164d1635d None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:53.781609 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:53.785457 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 206/429] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Sep 18 00:42:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:53.798597 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42d473d-0615-4c71-ae7c-89e164d1635d None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:53.809425 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4845e0b2-c2b3-447a-b2c6-dbe85215da5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:53.810173 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845e0b2-c2b3-447a-b2c6-dbe85215da5e None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:53.811077 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845e0b2-c2b3-447a-b2c6-dbe85215da5e None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:53.811077 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845e0b2-c2b3-447a-b2c6-dbe85215da5e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:53.823358 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4845e0b2-c2b3-447a-b2c6-dbe85215da5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:42:53.828952 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-4845e0b2-c2b3-447a-b2c6-dbe85215da5e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 18 00:42:53.828952 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:42:53.828952 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:42:53.828952 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:42:53.828952 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:42:53.828952 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:42:53.828952 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:42:53.828952 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:42:53.828952 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:42:53.828952 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:42:53.828952 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:42:53.828952 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:42:53.828952 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:42:53.828952 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:42:53.828952 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:42:53.828952 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:42:53.830701 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:42:53.830701 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:42:53.830701 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:42:53.830701 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:42:53.830701 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:42:53.830701 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:42:53.830701 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:42:53.830701 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:42:53.830701 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:42:53.830701 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:42:53.830701 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:42:53.830701 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:42:53.830701 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:42:53.830701 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:42:53.830701 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:42:53.830701 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:42:53.832860 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:42:53.832860 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:42:53.832860 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:42:53.832860 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:42:53.832860 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:42:53.832860 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:42:53.832860 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:42:53.832860 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:42:53.832860 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:42:53.832860 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:42:53.832860 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 18 00:42:53.832860 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:42:53.832860 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 224/430] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Sep 18 00:42:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 00:42:53.844985 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4845e0b2-c2b3-447a-b2c6-dbe85215da5e None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:53.952116 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:54.025377 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42d473d-0615-4c71-ae7c-89e164d1635d None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:54.068945 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4845e0b2-c2b3-447a-b2c6-dbe85215da5e None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:54.090198 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b9895e-0c47-457c-86ec-b76a430bb88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:54.091262 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9895e-0c47-457c-86ec-b76a430bb88e None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:54.091774 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9895e-0c47-457c-86ec-b76a430bb88e None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:54.092314 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9895e-0c47-457c-86ec-b76a430bb88e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:54.122897 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc72e817-09ee-4737-baa1-d017cb313beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:54.123522 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72e817-09ee-4737-baa1-d017cb313beb None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:54.123995 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72e817-09ee-4737-baa1-d017cb313beb None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:54.124415 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72e817-09ee-4737-baa1-d017cb313beb None admin] PATH_INFO: `/v3/roles` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:54.125114 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc72e817-09ee-4737-baa1-d017cb313beb None admin] RBAC: Adding query filter params (name=member) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:42:54.125424 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc72e817-09ee-4737-baa1-d017cb313beb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:54.126841 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc72e817-09ee-4737-baa1-d017cb313beb None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:54.145411 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 225/431] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Sep 18 00:42:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:54.145411 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711090c-0b93-49b0-92ee-4a6d7830982d None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:54.145411 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711090c-0b93-49b0-92ee-4a6d7830982d None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:54.145411 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711090c-0b93-49b0-92ee-4a6d7830982d None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:54.146471 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 226/432] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:42:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:42:54.147172 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0711090c-0b93-49b0-92ee-4a6d7830982d None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:54.194324 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:54.229387 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b9895e-0c47-457c-86ec-b76a430bb88e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:54.232574 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b9895e-0c47-457c-86ec-b76a430bb88e None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:54.293223 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0711090c-0b93-49b0-92ee-4a6d7830982d None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:54.348911 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:54.360074 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b141cc2-81d3-46ed-876b-d099ffaf65ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:54.361146 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b141cc2-81d3-46ed-876b-d099ffaf65ff None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:54.361659 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b141cc2-81d3-46ed-876b-d099ffaf65ff None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:54.362154 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b141cc2-81d3-46ed-876b-d099ffaf65ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:54.392330 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 207/433] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Sep 18 00:42:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 596 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 00:42:54.393994 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87bc57-77ef-4175-aa08-d1691ac738f6 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:54.395061 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87bc57-77ef-4175-aa08-d1691ac738f6 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:54.395343 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87bc57-77ef-4175-aa08-d1691ac738f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:54.417702 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-2b87bc57-77ef-4175-aa08-d1691ac738f6 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:42:54.419213 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-2b87bc57-77ef-4175-aa08-d1691ac738f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:42:54.511939 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b141cc2-81d3-46ed-876b-d099ffaf65ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:54.512339 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 208/434] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:42:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 00:42:54.512339 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b87bc57-77ef-4175-aa08-d1691ac738f6 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:54.512965 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b141cc2-81d3-46ed-876b-d099ffaf65ff None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:54.590427 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:54.727634 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:54.734451 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b87bc57-77ef-4175-aa08-d1691ac738f6 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:54.744051 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 227/435] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Sep 18 00:42:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 593 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 00:42:54.744051 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe2d28-dbda-4c99-b31a-7308a5700cc3 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:54.744051 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe2d28-dbda-4c99-b31a-7308a5700cc3 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:54.744051 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe2d28-dbda-4c99-b31a-7308a5700cc3 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:54.747998 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 228/436] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:42:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:42:54.751247 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fe2d28-dbda-4c99-b31a-7308a5700cc3 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:54.793723 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13157ac1-cee5-46dc-affb-f80afc5921a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:54.794826 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13157ac1-cee5-46dc-affb-f80afc5921a4 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:54.795309 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13157ac1-cee5-46dc-affb-f80afc5921a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:54.795818 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13157ac1-cee5-46dc-affb-f80afc5921a4 None admin] PATH_INFO: `/v3/projects/71680fa1985e4fc4a5c1a73f87753f66` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:54.797889 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13157ac1-cee5-46dc-affb-f80afc5921a4 None admin] RBAC: Authorizing `identity:get_project(project_id=71680fa1985e4fc4a5c1a73f87753f66)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:54.799994 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13157ac1-cee5-46dc-affb-f80afc5921a4 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:54.806802 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 209/437] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Sep 18 00:42:54 2022] GET /identity/v3/projects/71680fa1985e4fc4a5c1a73f87753f66 => generated 298 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:54.806802 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57973e-448b-43a5-a516-d3be0437dcc6 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:54.806802 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57973e-448b-43a5-a516-d3be0437dcc6 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:54.806802 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57973e-448b-43a5-a516-d3be0437dcc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:54.836431 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-ad57973e-448b-43a5-a516-d3be0437dcc6 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:42:54.838515 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-ad57973e-448b-43a5-a516-d3be0437dcc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:42:54.926761 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fe2d28-dbda-4c99-b31a-7308a5700cc3 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:54.940004 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 210/438] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:42:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 00:42:54.942044 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad57973e-448b-43a5-a516-d3be0437dcc6 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:54.971433 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4080c0c-ced7-46fd-ba7e-1cc060116359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:54.972710 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4080c0c-ced7-46fd-ba7e-1cc060116359 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:54.973111 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4080c0c-ced7-46fd-ba7e-1cc060116359 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:54.973578 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4080c0c-ced7-46fd-ba7e-1cc060116359 None admin] PATH_INFO: `/v3/projects/14cc5534b3054dfbbc19e546f4d51538` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:54.975602 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4080c0c-ced7-46fd-ba7e-1cc060116359 None admin] RBAC: Authorizing `identity:get_project(project_id=14cc5534b3054dfbbc19e546f4d51538)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:54.978346 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4080c0c-ced7-46fd-ba7e-1cc060116359 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:54.981469 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 229/439] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Sep 18 00:42:54 2022] GET /identity/v3/projects/14cc5534b3054dfbbc19e546f4d51538 => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:54.989277 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4080c0c-ced7-46fd-ba7e-1cc060116359 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:54.995759 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:55.075469 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:55.081650 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad57973e-448b-43a5-a516-d3be0437dcc6 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:55.137369 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4080c0c-ced7-46fd-ba7e-1cc060116359 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:55.140316 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc3304-8888-4465-b057-92bbdf352b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:55.142199 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc3304-8888-4465-b057-92bbdf352b7a None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:55.142645 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc3304-8888-4465-b057-92bbdf352b7a None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:55.143098 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc3304-8888-4465-b057-92bbdf352b7a None admin] PATH_INFO: `/v3/groups/15caa6296a0b49ebb84ae27cf4744cfc` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:55.145065 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbc3304-8888-4465-b057-92bbdf352b7a None admin] RBAC: Authorizing `identity:get_group(group_id=15caa6296a0b49ebb84ae27cf4744cfc)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:55.146718 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbc3304-8888-4465-b057-92bbdf352b7a None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:55.149742 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 211/440] 10.222.0.15 () {56 vars in 1180 bytes} [Sun Sep 18 00:42:54 2022] GET /identity/v3/groups/15caa6296a0b49ebb84ae27cf4744cfc => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:55.150890 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc3304-8888-4465-b057-92bbdf352b7a None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:55.188629 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef62acd-e317-42c0-b003-e5f25dcbfe0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:55.189607 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef62acd-e317-42c0-b003-e5f25dcbfe0e None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:55.190069 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef62acd-e317-42c0-b003-e5f25dcbfe0e None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:55.190477 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef62acd-e317-42c0-b003-e5f25dcbfe0e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:55.205181 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef62acd-e317-42c0-b003-e5f25dcbfe0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:42:55.211885 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-aef62acd-e317-42c0-b003-e5f25dcbfe0e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 18 00:42:55.211885 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:42:55.211885 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:42:55.211885 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:42:55.211885 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:42:55.211885 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:42:55.211885 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:42:55.211885 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:42:55.211885 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:42:55.211885 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:42:55.211885 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:42:55.211885 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:42:55.211885 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:42:55.211885 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:42:55.211885 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:42:55.211885 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:42:55.213731 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:42:55.213731 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:42:55.213731 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:42:55.213731 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:42:55.213731 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:42:55.213731 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:42:55.213731 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:42:55.213731 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:42:55.213731 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:42:55.213731 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:42:55.213731 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:42:55.213731 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:42:55.213731 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:42:55.213731 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:42:55.213731 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:42:55.213731 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:42:55.214815 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:42:55.214815 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:42:55.214815 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:42:55.214815 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:42:55.214815 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:42:55.214815 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:42:55.214815 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:42:55.214815 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:42:55.214815 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:42:55.214815 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:42:55.214815 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 18 00:42:55.214815 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:42:55.214815 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 230/441] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Sep 18 00:42:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:42:55.214815 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef62acd-e317-42c0-b003-e5f25dcbfe0e None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:55.274103 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc3304-8888-4465-b057-92bbdf352b7a None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:55.288815 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:55.318155 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8247e05-3d2b-4f2d-ab61-8334518d7519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:55.318816 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8247e05-3d2b-4f2d-ab61-8334518d7519 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:55.319101 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8247e05-3d2b-4f2d-ab61-8334518d7519 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:55.319380 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8247e05-3d2b-4f2d-ab61-8334518d7519 None admin] PATH_INFO: `/v3/groups/15caa6296a0b49ebb84ae27cf4744cfc` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:55.320683 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8247e05-3d2b-4f2d-ab61-8334518d7519 None admin] RBAC: Authorizing `identity:get_group(group_id=15caa6296a0b49ebb84ae27cf4744cfc)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:55.322188 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8247e05-3d2b-4f2d-ab61-8334518d7519 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:55.323928 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 212/442] 10.222.0.15 () {56 vars in 1180 bytes} [Sun Sep 18 00:42:55 2022] GET /identity/v3/groups/15caa6296a0b49ebb84ae27cf4744cfc => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:55.324783 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8247e05-3d2b-4f2d-ab61-8334518d7519 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:55.350641 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef62acd-e317-42c0-b003-e5f25dcbfe0e None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:55.374004 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:55.404231 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed7dae4-2291-4627-aaf1-1d5a185f815a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:55.405148 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed7dae4-2291-4627-aaf1-1d5a185f815a None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:55.405562 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed7dae4-2291-4627-aaf1-1d5a185f815a None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:55.405964 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed7dae4-2291-4627-aaf1-1d5a185f815a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:55.407137 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed7dae4-2291-4627-aaf1-1d5a185f815a None admin] RBAC: Adding query filter params (group.id=15caa6296a0b49ebb84ae27cf4744cfc, role.id=59d7218a321b4c20bc1996494a48a2a1, scope.project.id=71680fa1985e4fc4a5c1a73f87753f66) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:42:55.407561 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed7dae4-2291-4627-aaf1-1d5a185f815a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:55.409301 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed7dae4-2291-4627-aaf1-1d5a185f815a None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:55.417104 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 231/443] 10.222.0.15 () {56 vars in 1376 bytes} [Sun Sep 18 00:42:55 2022] GET /identity/v3/role_assignments?group.id=15caa6296a0b49ebb84ae27cf4744cfc&scope.project.id=71680fa1985e4fc4a5c1a73f87753f66&role.id=59d7218a321b4c20bc1996494a48a2a1 => generated 611 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:55.418404 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed7dae4-2291-4627-aaf1-1d5a185f815a None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:55.488763 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8247e05-3d2b-4f2d-ab61-8334518d7519 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:55.555733 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726eadf6-87e4-4194-8ea2-d43625b81ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:55.556978 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726eadf6-87e4-4194-8ea2-d43625b81ff2 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:55.557544 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726eadf6-87e4-4194-8ea2-d43625b81ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:55.558050 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726eadf6-87e4-4194-8ea2-d43625b81ff2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:55.580150 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726eadf6-87e4-4194-8ea2-d43625b81ff2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:42:55.580900 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed7dae4-2291-4627-aaf1-1d5a185f815a None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:55.590327 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-726eadf6-87e4-4194-8ea2-d43625b81ff2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 00:42:55.590327 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:42:55.590327 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:42:55.590327 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:42:55.590327 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:42:55.590327 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:42:55.590327 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:42:55.590327 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:42:55.590327 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:42:55.590327 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:42:55.590327 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:42:55.590327 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:42:55.590327 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:42:55.590327 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:42:55.590327 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:42:55.590327 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:42:55.592170 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:42:55.592170 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:42:55.592170 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:42:55.592170 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:42:55.592170 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:42:55.592170 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:42:55.592170 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:42:55.592170 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:42:55.592170 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:42:55.592170 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:42:55.592170 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:42:55.592170 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:42:55.592170 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:42:55.592170 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:42:55.592170 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:42:55.592170 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:42:55.593724 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:42:55.593724 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:42:55.593724 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:42:55.593724 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:42:55.593724 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:42:55.593724 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:42:55.593724 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:42:55.593724 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:42:55.593724 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:42:55.593724 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:42:55.593724 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 00:42:55.593724 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:42:55.593724 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 213/444] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Sep 18 00:42:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:42:55.596081 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726eadf6-87e4-4194-8ea2-d43625b81ff2 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:55.623394 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:55.637294 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4acd75-9ccf-44d3-b3c7-55dc693e696a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:55.638216 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4acd75-9ccf-44d3-b3c7-55dc693e696a None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:55.638521 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4acd75-9ccf-44d3-b3c7-55dc693e696a None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:55.638759 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4acd75-9ccf-44d3-b3c7-55dc693e696a None admin] PATH_INFO: `/v3/roles` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:55.639471 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4acd75-9ccf-44d3-b3c7-55dc693e696a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:42:55.639769 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4acd75-9ccf-44d3-b3c7-55dc693e696a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:55.641269 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4acd75-9ccf-44d3-b3c7-55dc693e696a None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:55.651595 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 232/445] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Sep 18 00:42:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:55.652328 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4acd75-9ccf-44d3-b3c7-55dc693e696a None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:55.742932 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:55.754334 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726eadf6-87e4-4194-8ea2-d43625b81ff2 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:55.815041 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d3f022-8537-4897-a4d6-1c13e09a426b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:55.815737 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d3f022-8537-4897-a4d6-1c13e09a426b None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:55.816051 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d3f022-8537-4897-a4d6-1c13e09a426b None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:55.816302 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d3f022-8537-4897-a4d6-1c13e09a426b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:55.817131 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d3f022-8537-4897-a4d6-1c13e09a426b None admin] RBAC: Adding query filter params (group.id=15caa6296a0b49ebb84ae27cf4744cfc, role.id=59d7218a321b4c20bc1996494a48a2a1, scope.project.id=14cc5534b3054dfbbc19e546f4d51538) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:42:55.817519 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d3f022-8537-4897-a4d6-1c13e09a426b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:55.819094 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d3f022-8537-4897-a4d6-1c13e09a426b None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:55.826911 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 214/446] 10.222.0.15 () {56 vars in 1376 bytes} [Sun Sep 18 00:42:55 2022] GET /identity/v3/role_assignments?group.id=15caa6296a0b49ebb84ae27cf4744cfc&scope.project.id=14cc5534b3054dfbbc19e546f4d51538&role.id=59d7218a321b4c20bc1996494a48a2a1 => generated 611 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:55.827821 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d3f022-8537-4897-a4d6-1c13e09a426b None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:55.848341 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4acd75-9ccf-44d3-b3c7-55dc693e696a None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:55.921699 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eab92c-3525-4cb9-b25a-35abb688a685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:55.923114 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eab92c-3525-4cb9-b25a-35abb688a685 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:55.923314 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eab92c-3525-4cb9-b25a-35abb688a685 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:55.923684 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eab92c-3525-4cb9-b25a-35abb688a685 None admin] PATH_INFO: `/v3/roles` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:55.925016 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eab92c-3525-4cb9-b25a-35abb688a685 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:42:55.926551 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eab92c-3525-4cb9-b25a-35abb688a685 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:55.929319 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eab92c-3525-4cb9-b25a-35abb688a685 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:55.950434 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 233/447] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Sep 18 00:42:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:55.959936 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eab92c-3525-4cb9-b25a-35abb688a685 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:56.016519 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d3f022-8537-4897-a4d6-1c13e09a426b None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:56.065677 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:56.088168 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14566bc-d090-4d0e-9caa-dc8111322e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:56.089167 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14566bc-d090-4d0e-9caa-dc8111322e11 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:56.089629 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14566bc-d090-4d0e-9caa-dc8111322e11 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:56.090089 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14566bc-d090-4d0e-9caa-dc8111322e11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:56.149430 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:56.150399 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eab92c-3525-4cb9-b25a-35abb688a685 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:56.215321 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e5e082-2ba4-417a-8bb1-69e29ccec5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:56.216259 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5e082-2ba4-417a-8bb1-69e29ccec5a5 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:56.216556 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5e082-2ba4-417a-8bb1-69e29ccec5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:56.216793 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5e082-2ba4-417a-8bb1-69e29ccec5a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:56.217997 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14566bc-d090-4d0e-9caa-dc8111322e11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:56.220535 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14566bc-d090-4d0e-9caa-dc8111322e11 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:56.319653 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e5e082-2ba4-417a-8bb1-69e29ccec5a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:56.321726 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e5e082-2ba4-417a-8bb1-69e29ccec5a5 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:56.399949 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 215/448] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Sep 18 00:42:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 00:42:56.404178 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:56.409525 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14566bc-d090-4d0e-9caa-dc8111322e11 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:56.484266 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 234/449] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Sep 18 00:42:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 00:42:56.490777 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e5e082-2ba4-417a-8bb1-69e29ccec5a5 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:56.492216 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:56.554783 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14566bc-d090-4d0e-9caa-dc8111322e11 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:56.601080 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c99c30-4711-4268-a1dc-b15b6c3f84b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:56.602096 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c99c30-4711-4268-a1dc-b15b6c3f84b2 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:56.602428 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c99c30-4711-4268-a1dc-b15b6c3f84b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:56.602889 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c99c30-4711-4268-a1dc-b15b6c3f84b2 None admin] PATH_INFO: `/v3/projects/14cc5534b3054dfbbc19e546f4d51538` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:56.604343 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c99c30-4711-4268-a1dc-b15b6c3f84b2 None admin] RBAC: Authorizing `identity:get_project(project_id=14cc5534b3054dfbbc19e546f4d51538)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:56.606015 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c99c30-4711-4268-a1dc-b15b6c3f84b2 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:56.608046 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 216/450] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Sep 18 00:42:56 2022] GET /identity/v3/projects/14cc5534b3054dfbbc19e546f4d51538 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:42:56.615492 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c99c30-4711-4268-a1dc-b15b6c3f84b2 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:56.630128 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e5e082-2ba4-417a-8bb1-69e29ccec5a5 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:56.686763 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9821d96a-efb5-4d80-a0b2-391c46c6d717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:56.687424 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9821d96a-efb5-4d80-a0b2-391c46c6d717 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:56.687714 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9821d96a-efb5-4d80-a0b2-391c46c6d717 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:56.688020 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9821d96a-efb5-4d80-a0b2-391c46c6d717 None admin] PATH_INFO: `/v3/projects/59ffbd91d29d4939bf7137c10c138592` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:56.689227 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9821d96a-efb5-4d80-a0b2-391c46c6d717 None admin] RBAC: Authorizing `identity:get_project(project_id=59ffbd91d29d4939bf7137c10c138592)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:56.690709 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9821d96a-efb5-4d80-a0b2-391c46c6d717 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:56.692601 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 235/451] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Sep 18 00:42:56 2022] GET /identity/v3/projects/59ffbd91d29d4939bf7137c10c138592 => generated 344 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:42:56.698473 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9821d96a-efb5-4d80-a0b2-391c46c6d717 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:56.725094 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:56.750634 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c99c30-4711-4268-a1dc-b15b6c3f84b2 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:56.794470 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:56.806338 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37415c12-e0d3-49ae-8396-5e97ffdaea75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:56.807153 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37415c12-e0d3-49ae-8396-5e97ffdaea75 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:56.807528 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37415c12-e0d3-49ae-8396-5e97ffdaea75 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:56.807909 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37415c12-e0d3-49ae-8396-5e97ffdaea75 None admin] PATH_INFO: `/v3/groups/15caa6296a0b49ebb84ae27cf4744cfc` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:56.809361 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37415c12-e0d3-49ae-8396-5e97ffdaea75 None admin] RBAC: Authorizing `identity:get_group(group_id=15caa6296a0b49ebb84ae27cf4744cfc)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:56.811059 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37415c12-e0d3-49ae-8396-5e97ffdaea75 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:56.812924 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 217/452] 10.222.0.15 () {56 vars in 1180 bytes} [Sun Sep 18 00:42:56 2022] GET /identity/v3/groups/15caa6296a0b49ebb84ae27cf4744cfc => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:42:56.820089 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9821d96a-efb5-4d80-a0b2-391c46c6d717 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:56.820347 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37415c12-e0d3-49ae-8396-5e97ffdaea75 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:56.867823 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa7e78-d4ff-44f8-9536-36475b35d285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:56.868607 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa7e78-d4ff-44f8-9536-36475b35d285 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:56.868991 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa7e78-d4ff-44f8-9536-36475b35d285 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:56.869365 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa7e78-d4ff-44f8-9536-36475b35d285 None admin] PATH_INFO: `/v3/groups/2fbebf9b35d14d719fb2342839d0d025` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:56.870817 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fa7e78-d4ff-44f8-9536-36475b35d285 None admin] RBAC: Authorizing `identity:get_group(group_id=2fbebf9b35d14d719fb2342839d0d025)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:56.872653 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fa7e78-d4ff-44f8-9536-36475b35d285 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:56.874416 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 236/453] 10.222.0.15 () {56 vars in 1180 bytes} [Sun Sep 18 00:42:56 2022] GET /identity/v3/groups/2fbebf9b35d14d719fb2342839d0d025 => generated 229 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:42:56.882935 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa7e78-d4ff-44f8-9536-36475b35d285 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:42:56.953435 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37415c12-e0d3-49ae-8396-5e97ffdaea75 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:56.995968 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54278d13-2b75-463a-813a-ec707a525064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:56.996989 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54278d13-2b75-463a-813a-ec707a525064 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:56.997441 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54278d13-2b75-463a-813a-ec707a525064 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:56.997881 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54278d13-2b75-463a-813a-ec707a525064 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:56.999440 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54278d13-2b75-463a-813a-ec707a525064 None admin] RBAC: Adding query filter params (group.id=15caa6296a0b49ebb84ae27cf4744cfc, role.id=e2a7bd363c424c5380514254ad1cc522, scope.project.id=14cc5534b3054dfbbc19e546f4d51538) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:42:57.000021 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54278d13-2b75-463a-813a-ec707a525064 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:57.002487 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54278d13-2b75-463a-813a-ec707a525064 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:57.006677 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:42:57.012361 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 218/454] 10.222.0.15 () {56 vars in 1376 bytes} [Sun Sep 18 00:42:56 2022] GET /identity/v3/role_assignments?group.id=15caa6296a0b49ebb84ae27cf4744cfc&scope.project.id=14cc5534b3054dfbbc19e546f4d51538&role.id=e2a7bd363c424c5380514254ad1cc522 => generated 611 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:42:57.023733 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa7e78-d4ff-44f8-9536-36475b35d285 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:42:57.067075 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e24fc3-b8db-4360-bc51-af11ec8e4aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:42:57.067782 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e24fc3-b8db-4360-bc51-af11ec8e4aa1 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:42:57.068170 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e24fc3-b8db-4360-bc51-af11ec8e4aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:42:57.068511 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e24fc3-b8db-4360-bc51-af11ec8e4aa1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:42:57.069357 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e24fc3-b8db-4360-bc51-af11ec8e4aa1 None admin] RBAC: Adding query filter params (group.id=2fbebf9b35d14d719fb2342839d0d025, role.id=591d4711dc204cf98003c8b7d7558506, scope.project.id=59ffbd91d29d4939bf7137c10c138592) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:42:57.069753 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e24fc3-b8db-4360-bc51-af11ec8e4aa1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:42:57.071351 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e24fc3-b8db-4360-bc51-af11ec8e4aa1 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:42:57.078632 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 237/455] 10.222.0.15 () {56 vars in 1376 bytes} [Sun Sep 18 00:42:56 2022] GET /identity/v3/role_assignments?group.id=2fbebf9b35d14d719fb2342839d0d025&scope.project.id=59ffbd91d29d4939bf7137c10c138592&role.id=591d4711dc204cf98003c8b7d7558506 => generated 611 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:43:00.586003 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351fb25f-8728-4b59-b570-a7d4937a5d2b None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:00.586879 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351fb25f-8728-4b59-b570-a7d4937a5d2b None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:00.587337 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351fb25f-8728-4b59-b570-a7d4937a5d2b None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:00.589149 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 219/456] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:43:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:43:00.595199 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09293984-316a-4ca7-a396-d65295a61e41 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:00.596153 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09293984-316a-4ca7-a396-d65295a61e41 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:00.596634 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09293984-316a-4ca7-a396-d65295a61e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:00.626108 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-09293984-316a-4ca7-a396-d65295a61e41 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:43:00.627810 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-09293984-316a-4ca7-a396-d65295a61e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:43:00.750539 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 238/457] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:43:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 18 00:43:00.811484 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8de19-c8aa-42f6-89f8-e3fff9b95881 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:00.812012 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8de19-c8aa-42f6-89f8-e3fff9b95881 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:00.812490 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8de19-c8aa-42f6-89f8-e3fff9b95881 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:00.815336 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 220/458] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:43:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:43:00.824517 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513bea6-21d7-45a9-b33f-fcc1f6405837 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:00.825018 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513bea6-21d7-45a9-b33f-fcc1f6405837 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:00.825487 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513bea6-21d7-45a9-b33f-fcc1f6405837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:00.873928 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-4513bea6-21d7-45a9-b33f-fcc1f6405837 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:43:00.876113 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-4513bea6-21d7-45a9-b33f-fcc1f6405837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:43:01.060200 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 239/459] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:43:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 00:43:01.311486 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af8de19-c8aa-42f6-89f8-e3fff9b95881 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:01.339257 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cceef9-e40f-48db-a185-cf6f813d780e None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:01.339726 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cceef9-e40f-48db-a185-cf6f813d780e None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:01.340250 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cceef9-e40f-48db-a185-cf6f813d780e None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:01.343161 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 240/460] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:43:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:43:01.349625 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4d030-b78e-4f3a-923a-1ccaaf66c6fc None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:01.350120 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4d030-b78e-4f3a-923a-1ccaaf66c6fc None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:01.350612 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4d030-b78e-4f3a-923a-1ccaaf66c6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:01.390379 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-f0d4d030-b78e-4f3a-923a-1ccaaf66c6fc None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:43:01.391826 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-f0d4d030-b78e-4f3a-923a-1ccaaf66c6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:43:01.422736 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:01.479004 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:01.515823 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 241/461] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:43:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 00:43:01.517231 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d4d030-b78e-4f3a-923a-1ccaaf66c6fc None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:01.578920 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af8de19-c8aa-42f6-89f8-e3fff9b95881 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:01.671921 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f52df38-ef7f-4733-9899-2e8aa7814c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:01.673556 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f52df38-ef7f-4733-9899-2e8aa7814c59 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:01.674079 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f52df38-ef7f-4733-9899-2e8aa7814c59 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:01.674547 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f52df38-ef7f-4733-9899-2e8aa7814c59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:01.698216 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f52df38-ef7f-4733-9899-2e8aa7814c59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:01.700129 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f52df38-ef7f-4733-9899-2e8aa7814c59 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:01.726644 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-3f52df38-ef7f-4733-9899-2e8aa7814c59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:01.726644 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:01.726644 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:01.726644 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:01.726644 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:01.726644 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:01.726644 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:01.726644 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:01.726644 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:01.726644 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:01.726644 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:01.726644 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:01.726644 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:43:01.726644 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:43:01.726644 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:43:01.726644 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:43:01.727593 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:01.727593 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:01.727593 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:01.727593 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:01.727593 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:01.727593 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:01.727593 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:01.727593 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:01.727593 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:01.727593 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:01.727593 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:01.727593 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:01.727593 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:01.727593 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:01.727593 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:01.727593 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:01.727593 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:43:01.728449 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:43:01.728449 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:01.728449 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:01.736426 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d4d030-b78e-4f3a-923a-1ccaaf66c6fc None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:01.738861 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 221/462] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:43:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 428 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:01.747642 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f52df38-ef7f-4733-9899-2e8aa7814c59 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:01.802664 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6e6cb9-5d4e-47b2-867d-33b25c59a9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:01.804159 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e6cb9-5d4e-47b2-867d-33b25c59a9a7 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:01.804426 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e6cb9-5d4e-47b2-867d-33b25c59a9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:01.804713 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e6cb9-5d4e-47b2-867d-33b25c59a9a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:01.817100 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6e6cb9-5d4e-47b2-867d-33b25c59a9a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:01.818678 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6e6cb9-5d4e-47b2-867d-33b25c59a9a7 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:01.820715 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:01.838195 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-de6e6cb9-5d4e-47b2-867d-33b25c59a9a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:01.838195 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:01.838195 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:01.838195 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:01.838195 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:01.838195 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:01.838195 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:01.838195 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:01.838195 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:01.838195 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:01.838195 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:01.838195 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:01.838195 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:43:01.838195 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:43:01.838195 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:43:01.838195 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:43:01.839132 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:01.839132 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:01.839132 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:01.839132 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:01.839132 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:01.839132 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:01.839132 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:01.839132 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:01.839132 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:01.839132 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:01.839132 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:01.839132 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:01.839132 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:01.839132 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:01.839132 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:01.839132 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:01.839132 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:43:01.840077 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:43:01.840077 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:01.840077 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:01.844351 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 242/463] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:43:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:01.845400 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6e6cb9-5d4e-47b2-867d-33b25c59a9a7 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:01.885491 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f52df38-ef7f-4733-9899-2e8aa7814c59 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:01.897190 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:01.928645 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c65b8-ade0-4970-a5e3-6dd45e9fbbef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:01.929530 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c65b8-ade0-4970-a5e3-6dd45e9fbbef None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:01.930463 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c65b8-ade0-4970-a5e3-6dd45e9fbbef None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:01.930884 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c65b8-ade0-4970-a5e3-6dd45e9fbbef None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:01.931984 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6c65b8-ade0-4970-a5e3-6dd45e9fbbef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:01.932432 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6c65b8-ade0-4970-a5e3-6dd45e9fbbef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:01.934986 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6c65b8-ade0-4970-a5e3-6dd45e9fbbef None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:01.957897 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 222/464] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:43:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:43:01.959396 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c65b8-ade0-4970-a5e3-6dd45e9fbbef None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:01.971115 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6e6cb9-5d4e-47b2-867d-33b25c59a9a7 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:02.013793 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a994aaea-76ba-472e-99a2-e582bfec8fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:02.014697 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a994aaea-76ba-472e-99a2-e582bfec8fb8 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:02.015081 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a994aaea-76ba-472e-99a2-e582bfec8fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:02.015478 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a994aaea-76ba-472e-99a2-e582bfec8fb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:02.029820 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a994aaea-76ba-472e-99a2-e582bfec8fb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:02.031668 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a994aaea-76ba-472e-99a2-e582bfec8fb8 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:02.054377 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-a994aaea-76ba-472e-99a2-e582bfec8fb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:02.054377 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:02.054377 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:02.054377 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:02.054377 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:02.054377 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:02.054377 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:02.054377 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:02.054377 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:02.054377 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:02.054377 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:02.054377 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:02.054377 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:43:02.054377 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:43:02.054377 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:43:02.054377 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:43:02.055354 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:02.055354 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:02.055354 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:02.055354 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:02.055354 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:02.055354 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:02.055354 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:02.055354 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:02.055354 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:02.055354 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:02.055354 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:02.055354 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:02.055354 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:02.055354 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:02.055354 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:02.055354 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:02.055354 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:43:02.056227 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:43:02.056227 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:02.056227 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:02.060451 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 243/465] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:43:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:02.061385 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a994aaea-76ba-472e-99a2-e582bfec8fb8 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:02.112683 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c65b8-ade0-4970-a5e3-6dd45e9fbbef None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:02.129681 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:02.181500 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c358847-25c5-4422-83c3-8ae24884ddb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:02.183088 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c358847-25c5-4422-83c3-8ae24884ddb5 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:02.183951 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c358847-25c5-4422-83c3-8ae24884ddb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:02.184793 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c358847-25c5-4422-83c3-8ae24884ddb5 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:02.186385 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c358847-25c5-4422-83c3-8ae24884ddb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:02.187378 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c358847-25c5-4422-83c3-8ae24884ddb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:02.190687 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c358847-25c5-4422-83c3-8ae24884ddb5 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:02.197638 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a994aaea-76ba-472e-99a2-e582bfec8fb8 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:02.214232 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 223/466] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:43:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:02.214854 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c358847-25c5-4422-83c3-8ae24884ddb5 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:02.252977 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:02.261019 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c551509b-c298-4422-b96f-3a8e8d9c614d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:02.262459 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551509b-c298-4422-b96f-3a8e8d9c614d None admin] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:02.263223 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551509b-c298-4422-b96f-3a8e8d9c614d None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:02.264106 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551509b-c298-4422-b96f-3a8e8d9c614d None admin] PATH_INFO: `/v3/users` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:02.265553 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c551509b-c298-4422-b96f-3a8e8d9c614d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:02.269431 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c551509b-c298-4422-b96f-3a8e8d9c614d None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:02.310336 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 244/467] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Sep 18 00:43:02 2022] POST /identity/v3/users => generated 246 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 00:43:02.313024 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a716b93-aba1-4302-b9aa-a21de3d631e1 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:02.313752 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a716b93-aba1-4302-b9aa-a21de3d631e1 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:02.314480 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a716b93-aba1-4302-b9aa-a21de3d631e1 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:02.317860 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 245/468] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:43:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:43:02.319829 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a716b93-aba1-4302-b9aa-a21de3d631e1 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:02.374788 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c358847-25c5-4422-83c3-8ae24884ddb5 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:02.430228 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f3999-9ec9-4922-88cd-96ad44950392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:02.431116 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f3999-9ec9-4922-88cd-96ad44950392 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:02.431515 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f3999-9ec9-4922-88cd-96ad44950392 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:02.431914 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f3999-9ec9-4922-88cd-96ad44950392 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:02.432738 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f3999-9ec9-4922-88cd-96ad44950392 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:02.433155 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f3999-9ec9-4922-88cd-96ad44950392 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:02.434817 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f3999-9ec9-4922-88cd-96ad44950392 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:02.451522 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 224/469] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:43:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:02.453877 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6221b3ac-5260-4a0b-98cd-763e06a1e2fe None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:02.454625 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6221b3ac-5260-4a0b-98cd-763e06a1e2fe None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:02.455258 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6221b3ac-5260-4a0b-98cd-763e06a1e2fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:02.478127 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-6221b3ac-5260-4a0b-98cd-763e06a1e2fe None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:43:02.479629 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-6221b3ac-5260-4a0b-98cd-763e06a1e2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:43:02.508740 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a716b93-aba1-4302-b9aa-a21de3d631e1 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:02.512172 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:02.570424 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 225/470] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:43:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 00:43:02.570988 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6221b3ac-5260-4a0b-98cd-763e06a1e2fe None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:02.579801 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df60ae1a-3f1a-4c91-8b6d-a46412eaed14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:02.580827 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df60ae1a-3f1a-4c91-8b6d-a46412eaed14 None admin] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:02.581287 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df60ae1a-3f1a-4c91-8b6d-a46412eaed14 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:02.582120 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df60ae1a-3f1a-4c91-8b6d-a46412eaed14 None admin] PATH_INFO: `/v3/users` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:02.582959 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df60ae1a-3f1a-4c91-8b6d-a46412eaed14 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:02.585547 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df60ae1a-3f1a-4c91-8b6d-a46412eaed14 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:02.605509 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:02.623119 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 246/471] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Sep 18 00:43:02 2022] POST /identity/v3/users => generated 248 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 00:43:02.625379 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d4eaa-d271-490e-8744-1daed12d9d96 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:02.625780 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d4eaa-d271-490e-8744-1daed12d9d96 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:02.626231 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d4eaa-d271-490e-8744-1daed12d9d96 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:02.635044 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 247/472] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:43:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:43:02.637698 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ad0c8-973a-45a9-a11a-def164e0ef57 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:02.638181 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ad0c8-973a-45a9-a11a-def164e0ef57 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:02.638898 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ad0c8-973a-45a9-a11a-def164e0ef57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:02.685194 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-c63ad0c8-973a-45a9-a11a-def164e0ef57 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:43:02.687659 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-c63ad0c8-973a-45a9-a11a-def164e0ef57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:43:02.805399 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6221b3ac-5260-4a0b-98cd-763e06a1e2fe None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:02.838279 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 248/473] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:43:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 00:43:02.870269 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ad0c8-973a-45a9-a11a-def164e0ef57 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:02.875642 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b2995-a4b1-46ce-88f6-b2aaa88bd170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:02.876237 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b2995-a4b1-46ce-88f6-b2aaa88bd170 None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:02.876544 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b2995-a4b1-46ce-88f6-b2aaa88bd170 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:02.876853 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b2995-a4b1-46ce-88f6-b2aaa88bd170 None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:02.877539 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5b2995-a4b1-46ce-88f6-b2aaa88bd170 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:02.879338 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5b2995-a4b1-46ce-88f6-b2aaa88bd170 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:02.911775 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 226/474] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Sep 18 00:43:02 2022] POST /identity/v3/users => generated 248 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 00:43:03.020489 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:03.039936 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ad0c8-973a-45a9-a11a-def164e0ef57 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:03.086836 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb093091-ddc2-43de-b557-b17c8091ce58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:03.087501 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb093091-ddc2-43de-b557-b17c8091ce58 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:03.087785 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb093091-ddc2-43de-b557-b17c8091ce58 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:03.088098 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb093091-ddc2-43de-b557-b17c8091ce58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:03.102036 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb093091-ddc2-43de-b557-b17c8091ce58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:03.103534 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb093091-ddc2-43de-b557-b17c8091ce58 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:03.120993 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-eb093091-ddc2-43de-b557-b17c8091ce58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:03.120993 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:03.120993 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:03.120993 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:03.120993 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:03.120993 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:03.120993 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:03.120993 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:03.120993 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:03.120993 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:03.120993 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:03.120993 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:03.120993 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:43:03.120993 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:43:03.120993 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:43:03.120993 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:43:03.122775 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:03.122775 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:03.122775 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:03.122775 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:03.122775 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:03.122775 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:03.122775 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:03.122775 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:03.122775 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:03.122775 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:03.122775 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:03.122775 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:03.122775 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:03.122775 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:03.122775 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:03.122775 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:03.122775 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:43:03.124514 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:43:03.124514 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:03.124514 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:03.124514 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 249/475] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:43:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 00:43:03.130799 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b2995-a4b1-46ce-88f6-b2aaa88bd170 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:03.219427 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb093091-ddc2-43de-b557-b17c8091ce58 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:03.227705 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:03.260771 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b2995-a4b1-46ce-88f6-b2aaa88bd170 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:03.318681 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be81b9d8-ecc2-485d-8af3-105456af30d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:03.319314 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81b9d8-ecc2-485d-8af3-105456af30d5 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:03.319596 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81b9d8-ecc2-485d-8af3-105456af30d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:03.319850 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81b9d8-ecc2-485d-8af3-105456af30d5 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:03.320632 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be81b9d8-ecc2-485d-8af3-105456af30d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:03.320942 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be81b9d8-ecc2-485d-8af3-105456af30d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:03.322352 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be81b9d8-ecc2-485d-8af3-105456af30d5 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:03.336071 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 227/476] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:43:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:03.341260 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be81b9d8-ecc2-485d-8af3-105456af30d5 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:03.368672 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb093091-ddc2-43de-b557-b17c8091ce58 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:03.418946 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b666a1-208f-4efd-a90c-ad8cfc72f5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:03.420088 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b666a1-208f-4efd-a90c-ad8cfc72f5a9 None admin] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:03.420979 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b666a1-208f-4efd-a90c-ad8cfc72f5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:03.421574 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b666a1-208f-4efd-a90c-ad8cfc72f5a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:03.422533 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b666a1-208f-4efd-a90c-ad8cfc72f5a9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:03.424106 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b666a1-208f-4efd-a90c-ad8cfc72f5a9 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:03.437101 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.sql.core [None req-b5b666a1-208f-4efd-a90c-ad8cfc72f5a9 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 18 00:43:03.437101 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 18 00:43:03.437101 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [parameters: {'id': '11804978ef0e4f5aa7ada99b558630f8', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 18 00:43:03.437101 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81571) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 18 00:43:03.457646 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-b5b666a1-208f-4efd-a90c-ad8cfc72f5a9 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 18 00:43:03.457646 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:03.457646 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 18 00:43:03.457646 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 18 00:43:03.457646 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 18 00:43:03.457646 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 18 00:43:03.457646 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 18 00:43:03.457646 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application result = self._query(query) Sep 18 00:43:03.457646 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 18 00:43:03.457646 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application conn.query(q) Sep 18 00:43:03.457646 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 18 00:43:03.457646 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 18 00:43:03.457646 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 18 00:43:03.457646 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application result.read() Sep 18 00:43:03.457646 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 18 00:43:03.458767 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 18 00:43:03.458767 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 18 00:43:03.458767 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 18 00:43:03.458767 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 18 00:43:03.458767 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 18 00:43:03.458767 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 18 00:43:03.458767 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 18 00:43:03.458767 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 18 00:43:03.458767 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:03.458767 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 18 00:43:03.458767 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:03.458767 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:03.458767 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 18 00:43:03.458767 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 18 00:43:03.458767 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 18 00:43:03.458767 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return ref.to_dict() Sep 18 00:43:03.458767 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 18 00:43:03.458767 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application next(self.gen) Sep 18 00:43:03.459833 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 18 00:43:03.459833 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application yield resource Sep 18 00:43:03.459833 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 18 00:43:03.459833 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application next(self.gen) Sep 18 00:43:03.459833 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 18 00:43:03.459833 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application self.session.rollback() Sep 18 00:43:03.459833 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 18 00:43:03.459833 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application self.force_reraise() Sep 18 00:43:03.459833 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 18 00:43:03.459833 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise self.value Sep 18 00:43:03.459833 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 18 00:43:03.459833 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 18 00:43:03.459833 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 18 00:43:03.459833 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application session.commit() Sep 18 00:43:03.459833 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 18 00:43:03.459833 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 18 00:43:03.459833 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 18 00:43:03.461383 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application self._prepare_impl() Sep 18 00:43:03.461383 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 18 00:43:03.461383 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application self.session.flush() Sep 18 00:43:03.461383 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 18 00:43:03.461383 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application self._flush(objects) Sep 18 00:43:03.461383 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 18 00:43:03.461383 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 18 00:43:03.461383 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 18 00:43:03.461383 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application compat.raise_( Sep 18 00:43:03.461383 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 18 00:43:03.461383 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception Sep 18 00:43:03.461383 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 18 00:43:03.461383 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application flush_context.execute() Sep 18 00:43:03.461383 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 18 00:43:03.461383 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rec.execute(self) Sep 18 00:43:03.461383 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 18 00:43:03.461383 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 18 00:43:03.462486 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 18 00:43:03.462486 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 18 00:43:03.462486 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 18 00:43:03.462486 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 18 00:43:03.462486 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 18 00:43:03.462486 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 18 00:43:03.462486 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 18 00:43:03.462486 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 18 00:43:03.462486 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 18 00:43:03.462486 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 18 00:43:03.462486 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 18 00:43:03.462486 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 18 00:43:03.462486 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 18 00:43:03.462486 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 18 00:43:03.462486 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 18 00:43:03.462486 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception Sep 18 00:43:03.463445 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 18 00:43:03.463445 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 18 00:43:03.463445 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 18 00:43:03.463445 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 18 00:43:03.463445 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 18 00:43:03.463445 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application result = self._query(query) Sep 18 00:43:03.463445 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 18 00:43:03.463445 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application conn.query(q) Sep 18 00:43:03.463445 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 18 00:43:03.463445 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 18 00:43:03.463445 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 18 00:43:03.463445 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application result.read() Sep 18 00:43:03.463445 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 18 00:43:03.463445 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 18 00:43:03.463445 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 18 00:43:03.463445 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 18 00:43:03.464326 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 18 00:43:03.464326 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 18 00:43:03.464326 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 18 00:43:03.464326 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 18 00:43:03.464326 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 18 00:43:03.464326 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 18 00:43:03.464326 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [parameters: {'id': '11804978ef0e4f5aa7ada99b558630f8', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 18 00:43:03.464326 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 18 00:43:03.464326 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:03.464326 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 18 00:43:03.464326 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:03.464326 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:03.464326 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:03.464326 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:03.464326 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:03.464326 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:03.465752 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:03.465752 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:03.465752 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:03.465752 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:03.465752 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:03.465752 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:03.465752 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 18 00:43:03.465752 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 18 00:43:03.465752 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:03.465752 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:03.465752 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 18 00:43:03.465752 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 18 00:43:03.465752 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 18 00:43:03.465752 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 18 00:43:03.465752 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 18 00:43:03.465752 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:03.467110 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 250/477] 10.222.0.15 () {60 vars in 1131 bytes} [Sun Sep 18 00:43:03 2022] POST /identity/v3/roles => generated 144 bytes in 249 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:03.473856 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b666a1-208f-4efd-a90c-ad8cfc72f5a9 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:03.484436 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:03.499668 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be81b9d8-ecc2-485d-8af3-105456af30d5 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:03.578745 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ee1c68-328f-4681-98f8-28abb8ca8ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:03.582396 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee1c68-328f-4681-98f8-28abb8ca8ee7 None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:03.582709 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee1c68-328f-4681-98f8-28abb8ca8ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:03.582986 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee1c68-328f-4681-98f8-28abb8ca8ee7 None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:03.583673 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ee1c68-328f-4681-98f8-28abb8ca8ee7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:03.585195 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ee1c68-328f-4681-98f8-28abb8ca8ee7 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:03.604694 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:03.629816 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 228/478] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Sep 18 00:43:03 2022] POST /identity/v3/users => generated 249 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 00:43:03.669701 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b666a1-208f-4efd-a90c-ad8cfc72f5a9 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:03.727762 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabf5fa1-4515-41d5-b40a-69f756411ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:03.728570 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf5fa1-4515-41d5-b40a-69f756411ac0 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:03.728909 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf5fa1-4515-41d5-b40a-69f756411ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:03.729190 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf5fa1-4515-41d5-b40a-69f756411ac0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:03.741313 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabf5fa1-4515-41d5-b40a-69f756411ac0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:43:03.747087 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-aabf5fa1-4515-41d5-b40a-69f756411ac0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 18 00:43:03.747087 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:03.747087 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:03.747087 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:03.747087 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:03.747087 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:03.747087 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:03.747087 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:03.747087 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:03.747087 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:03.747087 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:03.747087 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:03.747087 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:43:03.747087 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:43:03.747087 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:43:03.747087 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:43:03.748087 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:43:03.748087 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:43:03.748087 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:43:03.748087 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:43:03.748087 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:03.748087 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:03.748087 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:03.748087 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:03.748087 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:03.748087 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:03.748087 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:03.748087 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:03.748087 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:03.748087 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:03.748087 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:03.748087 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:03.748887 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:03.748887 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:03.748887 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:03.748887 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:03.748887 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:43:03.748887 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:43:03.748887 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:43:03.748887 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:43:03.748887 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:43:03.748887 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:43:03.748887 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 18 00:43:03.748887 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:03.748887 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 251/479] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Sep 18 00:43:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 00:43:03.762093 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ee1c68-328f-4681-98f8-28abb8ca8ee7 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:03.990936 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ee1c68-328f-4681-98f8-28abb8ca8ee7 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:04.053916 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea80e11-c5a7-46e2-8b4e-d3a4f23ee981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:04.054925 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea80e11-c5a7-46e2-8b4e-d3a4f23ee981 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:04.055454 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea80e11-c5a7-46e2-8b4e-d3a4f23ee981 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:04.055926 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea80e11-c5a7-46e2-8b4e-d3a4f23ee981 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:04.057083 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea80e11-c5a7-46e2-8b4e-d3a4f23ee981 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:04.057587 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea80e11-c5a7-46e2-8b4e-d3a4f23ee981 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:04.060210 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea80e11-c5a7-46e2-8b4e-d3a4f23ee981 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:04.077223 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 229/480] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Sep 18 00:43:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:43:05.874586 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c40cb-6fa0-4890-b4d3-1afb6ad8261f None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:05.875350 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c40cb-6fa0-4890-b4d3-1afb6ad8261f None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:05.875350 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c40cb-6fa0-4890-b4d3-1afb6ad8261f None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:05.876900 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 252/481] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:43:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:43:05.882209 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71617f96-2f40-4a0d-91a2-48cd7448af23 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:05.883071 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71617f96-2f40-4a0d-91a2-48cd7448af23 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:05.883071 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71617f96-2f40-4a0d-91a2-48cd7448af23 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:05.884193 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 230/482] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:43:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:43:05.885733 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3909c02-b462-474e-b695-ee4ea2ef3e95 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:05.886001 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3909c02-b462-474e-b695-ee4ea2ef3e95 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:05.886277 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3909c02-b462-474e-b695-ee4ea2ef3e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:05.900408 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e06106-1600-42c5-a641-06c4faf13af0 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:05.900833 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e06106-1600-42c5-a641-06c4faf13af0 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:05.901063 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e06106-1600-42c5-a641-06c4faf13af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:05.909764 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-c3909c02-b462-474e-b695-ee4ea2ef3e95 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:43:05.910989 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-c3909c02-b462-474e-b695-ee4ea2ef3e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:43:05.929672 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-96e06106-1600-42c5-a641-06c4faf13af0 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:43:05.931589 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-96e06106-1600-42c5-a641-06c4faf13af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:43:06.029868 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:06.039779 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:06.045443 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 253/483] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:43:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 00:43:06.079125 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 231/484] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:43:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 18 00:43:06.191493 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b1e10-d908-442f-9ba8-4a36e01f1190 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:06.191787 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b1e10-d908-442f-9ba8-4a36e01f1190 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:06.192148 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b1e10-d908-442f-9ba8-4a36e01f1190 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:06.193740 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 254/485] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:43:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:43:06.199303 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93e3d2-fbd2-4612-a2e8-91a4a715fdf2 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:06.199676 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93e3d2-fbd2-4612-a2e8-91a4a715fdf2 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:06.199833 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93e3d2-fbd2-4612-a2e8-91a4a715fdf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:06.224531 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-1a93e3d2-fbd2-4612-a2e8-91a4a715fdf2 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:43:06.225725 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-1a93e3d2-fbd2-4612-a2e8-91a4a715fdf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:43:06.332521 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 232/486] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:43:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 00:43:06.448313 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b1e10-d908-442f-9ba8-4a36e01f1190 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:06.527315 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a93e3d2-fbd2-4612-a2e8-91a4a715fdf2 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:06.601402 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b1e10-d908-442f-9ba8-4a36e01f1190 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:06.681245 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f1849-d23d-4ca2-9bcb-10d3ea07dee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:06.681901 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f1849-d23d-4ca2-9bcb-10d3ea07dee3 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:06.682181 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f1849-d23d-4ca2-9bcb-10d3ea07dee3 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:06.682442 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f1849-d23d-4ca2-9bcb-10d3ea07dee3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:06.691407 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a93e3d2-fbd2-4612-a2e8-91a4a715fdf2 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:06.708681 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6f1849-d23d-4ca2-9bcb-10d3ea07dee3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:43:06.713402 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-9b6f1849-d23d-4ca2-9bcb-10d3ea07dee3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 18 00:43:06.713402 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:06.713402 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:06.713402 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:06.713402 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:06.713402 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:06.713402 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:06.713402 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:06.713402 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:06.713402 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:06.713402 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:06.713402 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:06.713402 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:43:06.713402 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:43:06.713402 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:43:06.713402 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:43:06.715071 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:43:06.715071 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:43:06.715071 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:43:06.715071 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:43:06.715071 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:06.715071 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:06.715071 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:06.715071 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:06.715071 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:06.715071 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:06.715071 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:06.715071 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:06.715071 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:06.715071 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:06.715071 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:06.715071 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:06.716701 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:06.716701 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:06.716701 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:06.716701 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:06.716701 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:43:06.716701 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:43:06.716701 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:43:06.716701 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:43:06.716701 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:43:06.716701 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:43:06.716701 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 18 00:43:06.716701 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:06.723205 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 255/487] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Sep 18 00:43:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:06.724682 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f1849-d23d-4ca2-9bcb-10d3ea07dee3 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:06.725483 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:06.756035 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f6fae-a473-4350-a0e3-14e416f48524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:06.756696 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f6fae-a473-4350-a0e3-14e416f48524 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:06.756977 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f6fae-a473-4350-a0e3-14e416f48524 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:06.757776 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f6fae-a473-4350-a0e3-14e416f48524 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:06.772891 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460f6fae-a473-4350-a0e3-14e416f48524 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:43:06.777789 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-460f6fae-a473-4350-a0e3-14e416f48524 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 18 00:43:06.777789 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:06.777789 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:06.777789 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:06.777789 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:06.777789 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:06.777789 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:06.777789 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:06.777789 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:06.777789 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:06.777789 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:06.777789 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:06.777789 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:43:06.777789 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:43:06.777789 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:43:06.777789 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:43:06.780188 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:43:06.780188 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:43:06.780188 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:43:06.780188 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:43:06.780188 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:06.780188 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:06.780188 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:06.780188 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:06.780188 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:06.780188 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:06.780188 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:06.780188 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:06.780188 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:06.780188 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:06.780188 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:06.780188 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:06.781796 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:06.781796 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:06.781796 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:06.781796 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:06.781796 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:43:06.781796 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:43:06.781796 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:43:06.781796 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:43:06.781796 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:43:06.781796 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:43:06.781796 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 18 00:43:06.781796 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:06.781796 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 233/488] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Sep 18 00:43:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 00:43:06.781796 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f6fae-a473-4350-a0e3-14e416f48524 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:06.828377 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:06.890462 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f1849-d23d-4ca2-9bcb-10d3ea07dee3 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:06.941461 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e96ec1-c708-4c60-be2b-21e1117a9d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:06.942081 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e96ec1-c708-4c60-be2b-21e1117a9d89 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:06.942358 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e96ec1-c708-4c60-be2b-21e1117a9d89 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:06.942634 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e96ec1-c708-4c60-be2b-21e1117a9d89 None admin] PATH_INFO: `/v3/roles` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:06.943311 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e96ec1-c708-4c60-be2b-21e1117a9d89 None admin] RBAC: Adding query filter params (name=service) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:06.943614 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e96ec1-c708-4c60-be2b-21e1117a9d89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:06.945046 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e96ec1-c708-4c60-be2b-21e1117a9d89 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:06.957151 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 256/489] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Sep 18 00:43:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:06.958048 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e96ec1-c708-4c60-be2b-21e1117a9d89 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:06.976940 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f6fae-a473-4350-a0e3-14e416f48524 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:07.042828 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f6389c-b518-48a1-b694-8cb636701e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:07.044219 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6389c-b518-48a1-b694-8cb636701e4a None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:07.044938 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6389c-b518-48a1-b694-8cb636701e4a None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:07.045573 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6389c-b518-48a1-b694-8cb636701e4a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:07.067644 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f6389c-b518-48a1-b694-8cb636701e4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:43:07.078759 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-45f6389c-b518-48a1-b694-8cb636701e4a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 18 00:43:07.078759 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:07.078759 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:07.078759 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:07.078759 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:07.078759 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:07.078759 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:07.078759 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:07.078759 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:07.078759 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:07.078759 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:07.078759 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:07.078759 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:43:07.078759 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:43:07.078759 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:43:07.078759 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:43:07.082111 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:43:07.082111 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:43:07.082111 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:43:07.082111 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:43:07.082111 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:07.082111 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:07.082111 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:07.082111 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:07.082111 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:07.082111 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:07.082111 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:07.082111 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:07.082111 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:07.082111 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:07.082111 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:07.082111 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:07.085175 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:07.085175 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:07.085175 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:07.085175 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:07.085175 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:43:07.085175 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:43:07.085175 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:43:07.085175 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:43:07.085175 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:43:07.085175 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:43:07.085175 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 18 00:43:07.085175 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:07.085175 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 234/490] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Sep 18 00:43:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:07.085175 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f6389c-b518-48a1-b694-8cb636701e4a None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:07.097707 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e96ec1-c708-4c60-be2b-21e1117a9d89 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:07.110877 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:07.146079 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:07.146998 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3531b4fe-76b6-4ce2-8b82-7c7adb193c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:07.148301 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531b4fe-76b6-4ce2-8b82-7c7adb193c3e None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:07.148976 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531b4fe-76b6-4ce2-8b82-7c7adb193c3e None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:07.149651 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531b4fe-76b6-4ce2-8b82-7c7adb193c3e None admin] PATH_INFO: `/v3/roles` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:07.151257 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3531b4fe-76b6-4ce2-8b82-7c7adb193c3e None admin] RBAC: Adding query filter params (name=service) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:07.152024 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3531b4fe-76b6-4ce2-8b82-7c7adb193c3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:07.156447 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3531b4fe-76b6-4ce2-8b82-7c7adb193c3e None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:07.180163 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 257/491] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Sep 18 00:43:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:07.182184 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3531b4fe-76b6-4ce2-8b82-7c7adb193c3e None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:07.227839 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f6389c-b518-48a1-b694-8cb636701e4a None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:07.280982 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d438288-b652-4b32-ba67-883d979dce5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:07.282326 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d438288-b652-4b32-ba67-883d979dce5e None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:07.282916 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d438288-b652-4b32-ba67-883d979dce5e None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:07.283507 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d438288-b652-4b32-ba67-883d979dce5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:07.305529 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d438288-b652-4b32-ba67-883d979dce5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:07.308798 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d438288-b652-4b32-ba67-883d979dce5e None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:07.339486 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-7d438288-b652-4b32-ba67-883d979dce5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:07.339486 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:07.339486 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:07.339486 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:07.339486 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:07.339486 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:07.339486 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:07.339486 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:07.339486 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:07.339486 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:07.339486 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:07.339486 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:07.339486 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:43:07.339486 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:43:07.339486 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:43:07.339486 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:43:07.342350 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:07.342350 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:07.342350 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:07.342350 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:07.342350 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:07.342350 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:07.342350 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:07.342350 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:07.342350 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:07.342350 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:07.342350 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:07.342350 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:07.342350 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:07.342350 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:07.342350 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:07.342350 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:07.342350 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:43:07.353817 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:43:07.353817 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:07.353817 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:07.354435 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3531b4fe-76b6-4ce2-8b82-7c7adb193c3e None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:07.354671 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 235/492] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:43:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:07.354671 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d438288-b652-4b32-ba67-883d979dce5e None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:07.390093 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d061a421-b403-4f0e-8cd1-92758a4b0c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:07.391016 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061a421-b403-4f0e-8cd1-92758a4b0c19 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:07.391302 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061a421-b403-4f0e-8cd1-92758a4b0c19 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:07.391565 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061a421-b403-4f0e-8cd1-92758a4b0c19 None admin] PATH_INFO: `/v3/roles` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:07.392304 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d061a421-b403-4f0e-8cd1-92758a4b0c19 None admin] RBAC: Adding query filter params (name=service) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:07.392690 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d061a421-b403-4f0e-8cd1-92758a4b0c19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:07.394882 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d061a421-b403-4f0e-8cd1-92758a4b0c19 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:07.411645 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 258/493] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Sep 18 00:43:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:07.412831 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d061a421-b403-4f0e-8cd1-92758a4b0c19 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:07.474512 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:07.500644 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:07.518273 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d438288-b652-4b32-ba67-883d979dce5e None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:07.555600 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68a04ce-c656-4db1-a565-d461a9bde308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:07.556297 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a04ce-c656-4db1-a565-d461a9bde308 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:07.556550 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a04ce-c656-4db1-a565-d461a9bde308 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:07.556943 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a04ce-c656-4db1-a565-d461a9bde308 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:07.570217 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68a04ce-c656-4db1-a565-d461a9bde308 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:07.572996 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68a04ce-c656-4db1-a565-d461a9bde308 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:07.573435 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d061a421-b403-4f0e-8cd1-92758a4b0c19 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:07.599690 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-e68a04ce-c656-4db1-a565-d461a9bde308 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:07.599690 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:07.599690 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:07.599690 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:07.599690 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:07.599690 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:07.599690 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:07.599690 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:07.599690 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:07.599690 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:07.599690 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:07.599690 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:07.599690 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:43:07.599690 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:43:07.599690 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:43:07.599690 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:43:07.600829 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:07.600829 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:07.600829 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:07.600829 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:07.600829 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:07.600829 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:07.600829 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:07.600829 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:07.600829 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:07.600829 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:07.600829 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:07.600829 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:07.600829 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:07.600829 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:07.600829 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:07.600829 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:07.600829 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:43:07.601683 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:43:07.601683 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:07.601683 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:07.601841 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 236/494] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:43:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:07.603276 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68a04ce-c656-4db1-a565-d461a9bde308 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:07.618991 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c0c696-16f8-4067-b030-b399136dbf5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:07.620060 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c0c696-16f8-4067-b030-b399136dbf5b None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:07.620558 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c0c696-16f8-4067-b030-b399136dbf5b None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:07.621044 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c0c696-16f8-4067-b030-b399136dbf5b None admin] PATH_INFO: `/v3/domains` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:07.622204 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c0c696-16f8-4067-b030-b399136dbf5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:07.622753 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c0c696-16f8-4067-b030-b399136dbf5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:07.625347 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c0c696-16f8-4067-b030-b399136dbf5b None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:07.652397 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 259/495] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:43:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:07.652397 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1135343-92c3-4de9-967f-3dd5ae8bc214 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:07.652397 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1135343-92c3-4de9-967f-3dd5ae8bc214 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:07.652397 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1135343-92c3-4de9-967f-3dd5ae8bc214 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:07.654661 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 260/496] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:43:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:43:07.656144 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1135343-92c3-4de9-967f-3dd5ae8bc214 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:07.736232 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68a04ce-c656-4db1-a565-d461a9bde308 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:07.785574 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:07.786243 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d26eba-1759-40c9-8970-91a042024c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:07.787531 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d26eba-1759-40c9-8970-91a042024c0a None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:07.788104 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d26eba-1759-40c9-8970-91a042024c0a None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:07.788674 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d26eba-1759-40c9-8970-91a042024c0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:07.790620 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1135343-92c3-4de9-967f-3dd5ae8bc214 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:07.801423 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:07.807540 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d26eba-1759-40c9-8970-91a042024c0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:07.809307 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d26eba-1759-40c9-8970-91a042024c0a None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:07.826269 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-69d26eba-1759-40c9-8970-91a042024c0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:07.826269 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:07.826269 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:07.826269 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:07.826269 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:07.826269 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:07.826269 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:07.826269 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:07.826269 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:07.826269 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:07.826269 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:07.826269 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:07.826269 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:43:07.826269 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:43:07.826269 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:43:07.826269 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:43:07.827222 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:07.827222 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:07.827222 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:07.827222 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:07.827222 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:07.827222 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:07.827222 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:07.827222 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:07.827222 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:07.827222 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:07.827222 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:07.827222 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:07.827222 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:07.827222 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:07.827222 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:07.827222 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:07.827222 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:43:07.828087 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:43:07.828087 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:07.828087 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:07.828087 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 237/497] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:43:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:07.828320 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d26eba-1759-40c9-8970-91a042024c0a None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:07.844414 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591f8c31-4939-40ee-a912-94b2199b7f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:07.845057 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f8c31-4939-40ee-a912-94b2199b7f88 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:07.845338 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f8c31-4939-40ee-a912-94b2199b7f88 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:07.845615 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f8c31-4939-40ee-a912-94b2199b7f88 None admin] PATH_INFO: `/v3/domains` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:07.846279 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591f8c31-4939-40ee-a912-94b2199b7f88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:07.846582 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591f8c31-4939-40ee-a912-94b2199b7f88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:07.848079 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591f8c31-4939-40ee-a912-94b2199b7f88 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:07.864502 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 261/498] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:43:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:07.867295 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d56999-414e-4ad4-a2e2-72a293a92d0f None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:07.867799 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d56999-414e-4ad4-a2e2-72a293a92d0f None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:07.868305 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d56999-414e-4ad4-a2e2-72a293a92d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:07.906883 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-04d56999-414e-4ad4-a2e2-72a293a92d0f None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:43:07.909069 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-04d56999-414e-4ad4-a2e2-72a293a92d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:43:07.959409 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d26eba-1759-40c9-8970-91a042024c0a None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:07.997738 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c003df40-93d3-464e-ad61-a14531b52158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:07.998405 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003df40-93d3-464e-ad61-a14531b52158 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:07.998583 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003df40-93d3-464e-ad61-a14531b52158 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:07.998859 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003df40-93d3-464e-ad61-a14531b52158 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:08.007800 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c003df40-93d3-464e-ad61-a14531b52158 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:08.009329 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c003df40-93d3-464e-ad61-a14531b52158 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:08.023364 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-c003df40-93d3-464e-ad61-a14531b52158 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 18 00:43:08.023364 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:08.023364 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:08.023364 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:08.023364 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:08.023364 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:08.023364 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:08.023364 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:08.023364 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:08.023364 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:08.023364 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:08.023364 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:08.023364 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 00:43:08.023364 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 00:43:08.023364 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 00:43:08.023364 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 00:43:08.026117 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:08.026117 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:08.026117 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 00:43:08.026117 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:43:08.026117 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 00:43:08.026117 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:43:08.026117 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:08.026117 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:08.026117 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:08.026117 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:08.026117 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:08.026117 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:08.026117 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:08.026117 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:08.026117 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:08.026117 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:08.026117 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:08.026117 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:08.027879 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:08.027879 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:08.027879 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 00:43:08.027879 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 00:43:08.027879 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 00:43:08.027879 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 00:43:08.027879 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 00:43:08.027879 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 00:43:08.027879 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 18 00:43:08.027879 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:08.030226 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 262/499] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:43:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 00:43:08.030449 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 238/500] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Sep 18 00:43:07 2022] GET /identity/v3/users/glance => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:08.030449 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c003df40-93d3-464e-ad61-a14531b52158 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:08.030852 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d56999-414e-4ad4-a2e2-72a293a92d0f None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:08.100287 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:08.159160 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c003df40-93d3-464e-ad61-a14531b52158 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:08.172763 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:08.190280 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d56999-414e-4ad4-a2e2-72a293a92d0f None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:08.217615 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ece0bed-c15f-4a97-b3a9-5ce7d54caea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:08.218620 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece0bed-c15f-4a97-b3a9-5ce7d54caea3 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:08.219111 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece0bed-c15f-4a97-b3a9-5ce7d54caea3 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:08.219581 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece0bed-c15f-4a97-b3a9-5ce7d54caea3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:08.232124 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80087e-5da4-42c1-afcf-e93bbdea830c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:08.232755 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80087e-5da4-42c1-afcf-e93bbdea830c None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:08.233077 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80087e-5da4-42c1-afcf-e93bbdea830c None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:08.233774 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80087e-5da4-42c1-afcf-e93bbdea830c None admin] PATH_INFO: `/v3/domains` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:08.233982 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa80087e-5da4-42c1-afcf-e93bbdea830c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:08.234292 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa80087e-5da4-42c1-afcf-e93bbdea830c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:08.235407 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ece0bed-c15f-4a97-b3a9-5ce7d54caea3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:08.235705 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa80087e-5da4-42c1-afcf-e93bbdea830c None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:08.238318 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ece0bed-c15f-4a97-b3a9-5ce7d54caea3 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:08.254088 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-6ece0bed-c15f-4a97-b3a9-5ce7d54caea3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 18 00:43:08.254088 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:08.254088 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:08.254088 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:08.254088 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:08.254088 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:08.254088 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:08.254088 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:08.254088 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:08.254088 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:08.254088 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:08.254088 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:08.254088 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 00:43:08.254088 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 00:43:08.254088 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 00:43:08.254088 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 00:43:08.255065 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:08.255065 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:08.255065 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 00:43:08.255065 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:43:08.255065 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 00:43:08.255065 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:43:08.255065 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:08.255065 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:08.255065 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:08.255065 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:08.255065 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:08.255065 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:08.255065 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:08.255065 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:08.255065 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:08.255065 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:08.255065 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:08.255065 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:08.256540 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:08.256540 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:08.256540 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 00:43:08.256540 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 00:43:08.256540 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 00:43:08.256540 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 00:43:08.256540 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 00:43:08.256540 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 00:43:08.256540 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 18 00:43:08.256540 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:08.256540 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 239/501] 10.222.0.15 () {56 vars in 1093 bytes} [Sun Sep 18 00:43:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:08.257112 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b000d6a2-ffd0-49f1-aec6-d15476790889 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:08.257380 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b000d6a2-ffd0-49f1-aec6-d15476790889 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:08.257647 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b000d6a2-ffd0-49f1-aec6-d15476790889 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:08.259211 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 240/502] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:43:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:43:08.259918 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b000d6a2-ffd0-49f1-aec6-d15476790889 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:08.267996 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 263/503] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:43:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:08.267996 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80087e-5da4-42c1-afcf-e93bbdea830c None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:08.373589 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b000d6a2-ffd0-49f1-aec6-d15476790889 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:08.385140 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:08.412028 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ca58c-c137-40e6-8070-44a2aad0d309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:08.412656 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ca58c-c137-40e6-8070-44a2aad0d309 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:08.412937 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ca58c-c137-40e6-8070-44a2aad0d309 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:08.413214 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ca58c-c137-40e6-8070-44a2aad0d309 None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:08.413961 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36ca58c-c137-40e6-8070-44a2aad0d309 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:08.414268 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36ca58c-c137-40e6-8070-44a2aad0d309 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:08.415737 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36ca58c-c137-40e6-8070-44a2aad0d309 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:08.425504 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80087e-5da4-42c1-afcf-e93bbdea830c None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:08.454989 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 241/504] 10.222.0.15 () {56 vars in 1137 bytes} [Sun Sep 18 00:43:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:08.456412 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f895e9-56fa-4bb9-94bc-f386a05be09d None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:08.456709 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f895e9-56fa-4bb9-94bc-f386a05be09d None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:08.456993 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f895e9-56fa-4bb9-94bc-f386a05be09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:08.464279 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53019bdf-d510-48ba-850e-006a29e9a61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:08.464896 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53019bdf-d510-48ba-850e-006a29e9a61f None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:08.465171 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53019bdf-d510-48ba-850e-006a29e9a61f None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:08.465439 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53019bdf-d510-48ba-850e-006a29e9a61f None admin] PATH_INFO: `/v3/users` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:08.466176 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53019bdf-d510-48ba-850e-006a29e9a61f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:08.466482 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53019bdf-d510-48ba-850e-006a29e9a61f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:08.467991 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53019bdf-d510-48ba-850e-006a29e9a61f None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:08.482676 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-b9f895e9-56fa-4bb9-94bc-f386a05be09d None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:43:08.484214 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-b9f895e9-56fa-4bb9-94bc-f386a05be09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:43:08.537699 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 264/505] 10.222.0.15 () {56 vars in 1133 bytes} [Sun Sep 18 00:43:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:08.537699 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53019bdf-d510-48ba-850e-006a29e9a61f None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:08.546928 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:08.570315 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 242/506] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:43:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 00:43:08.571208 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f895e9-56fa-4bb9-94bc-f386a05be09d None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:08.674150 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53019bdf-d510-48ba-850e-006a29e9a61f None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:08.705711 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:08.712900 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f895e9-56fa-4bb9-94bc-f386a05be09d None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:08.718814 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf015149-4f60-4fd3-bcd2-5f2ec913a2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:08.719476 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf015149-4f60-4fd3-bcd2-5f2ec913a2be None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:08.719782 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf015149-4f60-4fd3-bcd2-5f2ec913a2be None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:08.720080 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf015149-4f60-4fd3-bcd2-5f2ec913a2be None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:08.729166 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf015149-4f60-4fd3-bcd2-5f2ec913a2be None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:08.730678 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf015149-4f60-4fd3-bcd2-5f2ec913a2be None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:08.745978 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-bf015149-4f60-4fd3-bcd2-5f2ec913a2be None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 18 00:43:08.745978 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:08.745978 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:08.745978 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:08.745978 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:08.745978 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:08.745978 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:08.745978 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:08.745978 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:08.745978 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:08.745978 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:08.745978 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:08.745978 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 00:43:08.745978 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 00:43:08.745978 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 00:43:08.745978 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 00:43:08.746938 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:08.746938 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:08.746938 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 00:43:08.746938 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:43:08.746938 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 00:43:08.746938 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:43:08.746938 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:08.746938 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:08.746938 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:08.746938 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:08.746938 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:08.746938 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:08.746938 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:08.746938 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:08.746938 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:08.746938 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:08.746938 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:08.746938 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:08.747828 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:08.747828 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:08.747828 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 00:43:08.747828 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 00:43:08.747828 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 00:43:08.747828 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 00:43:08.747828 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 00:43:08.747828 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 00:43:08.747828 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 18 00:43:08.747828 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:08.747828 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 265/507] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Sep 18 00:43:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:08.748437 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf015149-4f60-4fd3-bcd2-5f2ec913a2be None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:08.768564 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8f432-6d7f-4fd7-8582-f2808cef8d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:08.769800 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8f432-6d7f-4fd7-8582-f2808cef8d99 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:08.770082 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8f432-6d7f-4fd7-8582-f2808cef8d99 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:08.770740 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8f432-6d7f-4fd7-8582-f2808cef8d99 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:08.783170 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8f432-6d7f-4fd7-8582-f2808cef8d99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:43:08.788331 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-bdf8f432-6d7f-4fd7-8582-f2808cef8d99 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 18 00:43:08.788331 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:08.788331 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:08.788331 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:08.788331 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:08.788331 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:08.788331 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:08.788331 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:08.788331 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:08.788331 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:08.788331 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:08.788331 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:08.788331 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:43:08.788331 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:43:08.788331 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:43:08.788331 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:43:08.790134 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:43:08.790134 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:43:08.790134 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:43:08.790134 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:43:08.790134 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:08.790134 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:08.790134 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:08.790134 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:08.790134 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:08.790134 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:08.790134 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:08.790134 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:08.790134 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:08.790134 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:08.790134 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:08.790134 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:08.792585 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:08.792585 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:08.792585 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:08.792585 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:08.792585 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:43:08.792585 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:43:08.792585 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:43:08.792585 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:43:08.792585 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:43:08.792585 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:43:08.792585 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 18 00:43:08.792585 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:08.792585 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 243/508] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Sep 18 00:43:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:08.792585 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8f432-6d7f-4fd7-8582-f2808cef8d99 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:08.850363 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:08.888726 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf015149-4f60-4fd3-bcd2-5f2ec913a2be None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:08.928316 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8f432-6d7f-4fd7-8582-f2808cef8d99 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:08.928880 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e4de73-1dd8-4257-837e-a595d2653f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:08.929733 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4de73-1dd8-4257-837e-a595d2653f98 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:08.930157 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4de73-1dd8-4257-837e-a595d2653f98 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:08.930527 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4de73-1dd8-4257-837e-a595d2653f98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:08.967165 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ab311-6374-462c-819b-59016f201fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:08.967791 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ab311-6374-462c-819b-59016f201fd8 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:08.968102 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ab311-6374-462c-819b-59016f201fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:08.969240 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ab311-6374-462c-819b-59016f201fd8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:09.000693 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:09.009157 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e4de73-1dd8-4257-837e-a595d2653f98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:09.011022 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e4de73-1dd8-4257-837e-a595d2653f98 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:09.049633 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072ab311-6374-462c-819b-59016f201fd8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:09.051967 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072ab311-6374-462c-819b-59016f201fd8 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:09.087660 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:09.128777 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 266/509] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Sep 18 00:43:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 00:43:09.129682 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e4de73-1dd8-4257-837e-a595d2653f98 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:09.178300 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 244/510] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Sep 18 00:43:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 00:43:09.178971 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ab311-6374-462c-819b-59016f201fd8 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:09.248612 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:09.250129 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e4de73-1dd8-4257-837e-a595d2653f98 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:09.288954 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f62e95-c28c-49dd-9be6-9d9e61afa38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:09.289666 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f62e95-c28c-49dd-9be6-9d9e61afa38f None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:09.290200 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f62e95-c28c-49dd-9be6-9d9e61afa38f None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:09.290538 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f62e95-c28c-49dd-9be6-9d9e61afa38f None admin] PATH_INFO: `/v3/users` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:09.292168 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f62e95-c28c-49dd-9be6-9d9e61afa38f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:09.292581 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f62e95-c28c-49dd-9be6-9d9e61afa38f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:09.294199 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f62e95-c28c-49dd-9be6-9d9e61afa38f None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:09.301855 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ab311-6374-462c-819b-59016f201fd8 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:09.315052 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 267/511] 10.222.0.15 () {56 vars in 1137 bytes} [Sun Sep 18 00:43:09 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:09.315985 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f62e95-c28c-49dd-9be6-9d9e61afa38f None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:09.341443 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b2869b-72e0-4caa-91a5-f6810e983d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:09.342163 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2869b-72e0-4caa-91a5-f6810e983d5d None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:09.342565 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2869b-72e0-4caa-91a5-f6810e983d5d None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:09.342924 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2869b-72e0-4caa-91a5-f6810e983d5d None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:09.343675 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b2869b-72e0-4caa-91a5-f6810e983d5d None admin] RBAC: Adding query filter params (name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:09.344116 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b2869b-72e0-4caa-91a5-f6810e983d5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:09.345613 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b2869b-72e0-4caa-91a5-f6810e983d5d None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:09.348077 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:09.363024 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 245/512] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Sep 18 00:43:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:09.363024 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b2869b-72e0-4caa-91a5-f6810e983d5d None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:09.438056 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f62e95-c28c-49dd-9be6-9d9e61afa38f None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:09.477897 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2127eec-7ecc-42c3-b96d-3165fc306bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:09.478412 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b2869b-72e0-4caa-91a5-f6810e983d5d None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:09.478537 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2127eec-7ecc-42c3-b96d-3165fc306bf0 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:09.478815 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2127eec-7ecc-42c3-b96d-3165fc306bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:09.479122 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2127eec-7ecc-42c3-b96d-3165fc306bf0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:09.490355 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2127eec-7ecc-42c3-b96d-3165fc306bf0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:09.491816 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2127eec-7ecc-42c3-b96d-3165fc306bf0 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:09.501456 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:09.508722 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-c2127eec-7ecc-42c3-b96d-3165fc306bf0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:09.508722 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:09.508722 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:09.508722 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:09.508722 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:09.508722 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:09.508722 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:09.508722 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:09.508722 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:09.508722 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:09.508722 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:09.508722 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:09.508722 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:43:09.508722 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:43:09.508722 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:43:09.508722 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:43:09.510143 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:09.510143 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:09.510143 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:09.510143 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:09.510143 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:09.510143 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:09.510143 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:09.510143 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:09.510143 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:09.510143 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:09.510143 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:09.510143 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:09.510143 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:09.510143 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:09.510143 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:09.510143 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:09.510143 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:43:09.511332 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:43:09.511332 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:09.511332 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:09.515145 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 268/513] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:43:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:09.516052 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2127eec-7ecc-42c3-b96d-3165fc306bf0 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:09.516689 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c912861c-4fc0-45e6-bc10-01bed71ca578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:09.517445 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912861c-4fc0-45e6-bc10-01bed71ca578 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:09.517725 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912861c-4fc0-45e6-bc10-01bed71ca578 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:09.517997 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912861c-4fc0-45e6-bc10-01bed71ca578 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:09.530505 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c912861c-4fc0-45e6-bc10-01bed71ca578 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:09.532225 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c912861c-4fc0-45e6-bc10-01bed71ca578 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:09.551099 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-c912861c-4fc0-45e6-bc10-01bed71ca578 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:09.551099 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:09.551099 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:09.551099 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:09.551099 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:09.551099 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:09.551099 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:09.551099 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:09.551099 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:09.551099 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:09.551099 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:09.551099 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:09.551099 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:43:09.551099 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:43:09.551099 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:43:09.551099 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:43:09.552419 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:09.552419 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:09.552419 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:09.552419 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:09.552419 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:09.552419 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:09.552419 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:09.552419 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:09.552419 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:09.552419 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:09.552419 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:09.552419 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:09.552419 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:09.552419 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:09.552419 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:09.552419 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:09.552419 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:43:09.554355 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:43:09.554355 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:09.554355 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:09.554355 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 246/514] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:43:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:09.554355 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c912861c-4fc0-45e6-bc10-01bed71ca578 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:09.609162 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:09.634791 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2127eec-7ecc-42c3-b96d-3165fc306bf0 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:09.667027 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c912861c-4fc0-45e6-bc10-01bed71ca578 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:09.672588 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47218e9e-5856-42e8-b599-86d36768985a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:09.673243 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47218e9e-5856-42e8-b599-86d36768985a None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:09.673529 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47218e9e-5856-42e8-b599-86d36768985a None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:09.673794 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47218e9e-5856-42e8-b599-86d36768985a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:09.686161 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47218e9e-5856-42e8-b599-86d36768985a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:09.687652 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47218e9e-5856-42e8-b599-86d36768985a None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:09.703712 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-47218e9e-5856-42e8-b599-86d36768985a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:09.703712 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:09.703712 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:09.703712 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:09.703712 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:09.703712 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:09.703712 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:09.703712 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:09.703712 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:09.703712 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:09.703712 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:09.703712 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:09.703712 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:43:09.703712 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:43:09.703712 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:43:09.703712 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:43:09.705293 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:09.705293 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:09.705293 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:09.705293 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:09.705293 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:09.705293 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:09.705293 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:09.705293 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:09.705293 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:09.705293 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:09.705293 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:09.705293 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:09.705293 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:09.705293 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:09.705293 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:09.705293 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:09.705293 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:43:09.706170 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:43:09.706170 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:09.706170 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:09.706170 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 269/515] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:43:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:09.706170 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47218e9e-5856-42e8-b599-86d36768985a None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:09.710858 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f4514-55bb-43be-859d-c6613de7d380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:09.711509 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f4514-55bb-43be-859d-c6613de7d380 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:09.711790 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f4514-55bb-43be-859d-c6613de7d380 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:09.712110 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f4514-55bb-43be-859d-c6613de7d380 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:09.756711 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:09.787307 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845f4514-55bb-43be-859d-c6613de7d380 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:09.788971 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845f4514-55bb-43be-859d-c6613de7d380 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:09.815012 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47218e9e-5856-42e8-b599-86d36768985a None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:09.846303 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:09.854100 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9c8e4-7e4c-46d2-a9d2-4c02fed337a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:09.854999 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9c8e4-7e4c-46d2-a9d2-4c02fed337a7 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:09.855271 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9c8e4-7e4c-46d2-a9d2-4c02fed337a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:09.855549 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9c8e4-7e4c-46d2-a9d2-4c02fed337a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:09.867769 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a9c8e4-7e4c-46d2-a9d2-4c02fed337a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:09.869330 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a9c8e4-7e4c-46d2-a9d2-4c02fed337a7 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:09.886558 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-42a9c8e4-7e4c-46d2-a9d2-4c02fed337a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:09.886558 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:09.886558 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:09.886558 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:09.886558 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:09.886558 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:09.886558 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:09.886558 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:09.886558 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:09.886558 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:09.886558 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:09.886558 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:09.886558 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:43:09.886558 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:43:09.886558 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:43:09.886558 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:43:09.887843 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:09.887843 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:09.887843 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:09.887843 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:09.887843 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:09.887843 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:09.887843 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:09.887843 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:09.887843 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:09.887843 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:09.887843 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:09.887843 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:09.887843 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:09.887843 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:09.887843 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:09.887843 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:09.887843 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:43:09.889495 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:43:09.889495 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:09.889495 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:09.889495 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 270/516] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:43:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:09.889495 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9c8e4-7e4c-46d2-a9d2-4c02fed337a7 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:09.902892 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 247/517] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Sep 18 00:43:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 00:43:09.903776 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f4514-55bb-43be-859d-c6613de7d380 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:09.983919 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:10.005869 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9c8e4-7e4c-46d2-a9d2-4c02fed337a7 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:10.015326 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f4514-55bb-43be-859d-c6613de7d380 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:10.042615 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664a679-929c-4cd9-b72d-7289fcd774ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:10.043225 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664a679-929c-4cd9-b72d-7289fcd774ce None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:10.043503 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664a679-929c-4cd9-b72d-7289fcd774ce None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:10.043775 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664a679-929c-4cd9-b72d-7289fcd774ce None admin] PATH_INFO: `/v3/domains` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:10.044458 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c664a679-929c-4cd9-b72d-7289fcd774ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:10.044756 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c664a679-929c-4cd9-b72d-7289fcd774ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:10.046139 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c664a679-929c-4cd9-b72d-7289fcd774ce None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:10.052649 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ceffc0-1068-4ad3-9478-6fd134555260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:10.053262 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ceffc0-1068-4ad3-9478-6fd134555260 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:10.053549 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ceffc0-1068-4ad3-9478-6fd134555260 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:10.053821 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ceffc0-1068-4ad3-9478-6fd134555260 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:10.054465 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ceffc0-1068-4ad3-9478-6fd134555260 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:10.054764 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ceffc0-1068-4ad3-9478-6fd134555260 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:10.056191 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ceffc0-1068-4ad3-9478-6fd134555260 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:10.058972 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 271/518] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:43:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:10.059765 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664a679-929c-4cd9-b72d-7289fcd774ce None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:10.069779 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 248/519] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:43:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:10.070538 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ceffc0-1068-4ad3-9478-6fd134555260 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:10.111477 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:10.172485 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664a679-929c-4cd9-b72d-7289fcd774ce None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:10.188890 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ceffc0-1068-4ad3-9478-6fd134555260 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:10.211380 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f30ec9-9ba1-41ba-b6af-cfd5d5d93507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:10.212150 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f30ec9-9ba1-41ba-b6af-cfd5d5d93507 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:10.212444 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f30ec9-9ba1-41ba-b6af-cfd5d5d93507 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:10.212706 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f30ec9-9ba1-41ba-b6af-cfd5d5d93507 None admin] PATH_INFO: `/v3/domains` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:10.213353 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f30ec9-9ba1-41ba-b6af-cfd5d5d93507 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:10.213654 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f30ec9-9ba1-41ba-b6af-cfd5d5d93507 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:10.215032 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f30ec9-9ba1-41ba-b6af-cfd5d5d93507 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:10.224601 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:10.227701 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 272/520] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:43:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:10.229274 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f30ec9-9ba1-41ba-b6af-cfd5d5d93507 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:10.233762 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6616da6e-cbdd-47ca-9536-13819c741ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:10.234620 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616da6e-cbdd-47ca-9536-13819c741ec2 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:10.234915 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616da6e-cbdd-47ca-9536-13819c741ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:10.235627 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616da6e-cbdd-47ca-9536-13819c741ec2 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:10.236313 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6616da6e-cbdd-47ca-9536-13819c741ec2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:10.236624 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6616da6e-cbdd-47ca-9536-13819c741ec2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:10.238536 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6616da6e-cbdd-47ca-9536-13819c741ec2 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:10.251371 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 249/521] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:43:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:10.252527 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6616da6e-cbdd-47ca-9536-13819c741ec2 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:10.354563 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f30ec9-9ba1-41ba-b6af-cfd5d5d93507 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:10.356123 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:10.367029 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6616da6e-cbdd-47ca-9536-13819c741ec2 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:10.390791 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b24268b-7588-4039-9e14-cb7896548705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:10.391413 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24268b-7588-4039-9e14-cb7896548705 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:10.391695 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24268b-7588-4039-9e14-cb7896548705 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:10.391995 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24268b-7588-4039-9e14-cb7896548705 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:10.402726 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda05778-4246-48f3-a2b6-e8dcad853bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:10.403531 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda05778-4246-48f3-a2b6-e8dcad853bec None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:10.403976 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda05778-4246-48f3-a2b6-e8dcad853bec None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:10.404176 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b24268b-7588-4039-9e14-cb7896548705 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:10.404433 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda05778-4246-48f3-a2b6-e8dcad853bec None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:10.405242 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda05778-4246-48f3-a2b6-e8dcad853bec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:10.405579 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b24268b-7588-4039-9e14-cb7896548705 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:10.406984 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda05778-4246-48f3-a2b6-e8dcad853bec None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:10.423285 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-1b24268b-7588-4039-9e14-cb7896548705 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:10.423285 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:10.423285 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:10.423285 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:10.423285 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:10.423285 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:10.423285 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:10.423285 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:10.423285 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:10.423285 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:10.423285 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:10.423285 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:10.423285 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:43:10.423285 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:43:10.423285 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:43:10.423285 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:43:10.425897 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:10.425897 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:10.425897 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:10.425897 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:10.425897 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:10.425897 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:10.425897 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:10.425897 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:10.425897 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:10.425897 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:10.425897 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:10.425897 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:10.425897 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:10.425897 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:10.425897 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:10.425897 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:10.425897 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:43:10.427417 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:43:10.427417 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:10.427417 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:10.430052 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 273/522] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:43:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:10.430905 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b24268b-7588-4039-9e14-cb7896548705 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:10.433645 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 250/523] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Sep 18 00:43:10 2022] POST /identity/v3/users => generated 247 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 00:43:10.435454 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda05778-4246-48f3-a2b6-e8dcad853bec None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:10.513215 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:10.555178 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b24268b-7588-4039-9e14-cb7896548705 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:10.594722 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d3a232-5751-426c-9b0f-e0f810a33f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:10.595490 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3a232-5751-426c-9b0f-e0f810a33f89 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:10.595780 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3a232-5751-426c-9b0f-e0f810a33f89 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:10.596086 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3a232-5751-426c-9b0f-e0f810a33f89 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:10.602101 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda05778-4246-48f3-a2b6-e8dcad853bec None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:10.604309 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d3a232-5751-426c-9b0f-e0f810a33f89 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:10.606147 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d3a232-5751-426c-9b0f-e0f810a33f89 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:10.620388 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-88d3a232-5751-426c-9b0f-e0f810a33f89 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:43:10.620388 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:10.620388 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:10.620388 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:10.620388 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:10.620388 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:10.620388 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:10.620388 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:10.620388 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:10.620388 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:10.620388 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:10.620388 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:10.620388 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 00:43:10.620388 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 00:43:10.620388 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 00:43:10.622039 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 00:43:10.622039 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:10.622039 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:10.622039 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:10.622039 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:10.622039 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:10.622039 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:10.622039 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:10.622039 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:10.622039 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:10.622039 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:10.622039 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:10.622039 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:10.622039 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:10.622039 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:10.622039 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:10.622039 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:10.623623 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 00:43:10.623623 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 00:43:10.623623 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 00:43:10.623623 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 00:43:10.623623 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 00:43:10.623623 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 00:43:10.623623 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:43:10.623623 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:10.623623 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 274/524] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Sep 18 00:43:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:10.623623 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d3a232-5751-426c-9b0f-e0f810a33f89 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:10.643022 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:10.664489 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1817492f-29e6-482f-ac97-218c49d97c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:10.665163 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1817492f-29e6-482f-ac97-218c49d97c3a None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:10.665443 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1817492f-29e6-482f-ac97-218c49d97c3a None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:10.665726 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1817492f-29e6-482f-ac97-218c49d97c3a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:10.673957 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1817492f-29e6-482f-ac97-218c49d97c3a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:10.676064 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1817492f-29e6-482f-ac97-218c49d97c3a None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:10.694337 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-1817492f-29e6-482f-ac97-218c49d97c3a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:43:10.694337 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:10.694337 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:10.694337 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:10.694337 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:10.694337 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:10.694337 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:10.694337 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:10.694337 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:10.694337 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:10.694337 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:10.694337 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:10.694337 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 00:43:10.694337 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 00:43:10.694337 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 00:43:10.695241 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 00:43:10.695241 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:10.695241 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:10.695241 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:10.695241 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:10.695241 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:10.695241 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:10.695241 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:10.695241 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:10.695241 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:10.695241 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:10.695241 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:10.695241 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:10.695241 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:10.695241 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:10.695241 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:10.695241 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:10.697102 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 00:43:10.697102 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 00:43:10.697102 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 00:43:10.697102 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 00:43:10.697102 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 00:43:10.697102 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 00:43:10.697102 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:43:10.697102 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:10.697102 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 251/525] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Sep 18 00:43:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:10.697646 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1817492f-29e6-482f-ac97-218c49d97c3a None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:10.762849 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d3a232-5751-426c-9b0f-e0f810a33f89 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:10.806850 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065f1696-6910-4a3d-9001-afde4e1d1621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:10.807579 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f1696-6910-4a3d-9001-afde4e1d1621 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:10.808045 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f1696-6910-4a3d-9001-afde4e1d1621 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:10.808506 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f1696-6910-4a3d-9001-afde4e1d1621 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:10.819157 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065f1696-6910-4a3d-9001-afde4e1d1621 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:10.820968 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065f1696-6910-4a3d-9001-afde4e1d1621 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:10.822079 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1817492f-29e6-482f-ac97-218c49d97c3a None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:10.833039 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:10.833914 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-065f1696-6910-4a3d-9001-afde4e1d1621 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 18 00:43:10.833914 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:10.833914 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:10.833914 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:10.833914 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:10.833914 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:10.833914 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:10.833914 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:10.833914 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:10.833914 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:10.833914 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:10.833914 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:10.833914 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 00:43:10.833914 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 00:43:10.833914 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 00:43:10.833914 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 00:43:10.835565 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:10.835565 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:10.835565 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 00:43:10.835565 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:43:10.835565 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 00:43:10.835565 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:43:10.835565 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:10.835565 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:10.835565 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:10.835565 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:10.835565 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:10.835565 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:10.835565 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:10.835565 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:10.835565 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:10.835565 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:10.835565 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:10.835565 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:10.836833 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:10.836833 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:10.836833 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 00:43:10.836833 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 00:43:10.836833 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 00:43:10.836833 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 00:43:10.836833 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 00:43:10.836833 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 00:43:10.836833 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 18 00:43:10.836833 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:10.836833 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 275/526] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Sep 18 00:43:10 2022] GET /identity/v3/users/neutron => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:10.840652 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065f1696-6910-4a3d-9001-afde4e1d1621 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:10.872886 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8296404-d452-4b65-9ea9-423861d36e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:10.873715 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8296404-d452-4b65-9ea9-423861d36e0a None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:10.874123 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8296404-d452-4b65-9ea9-423861d36e0a None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:10.874593 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8296404-d452-4b65-9ea9-423861d36e0a None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:10.875360 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8296404-d452-4b65-9ea9-423861d36e0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:10.875848 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8296404-d452-4b65-9ea9-423861d36e0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:10.877656 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8296404-d452-4b65-9ea9-423861d36e0a None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:10.892486 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 252/527] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:43:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:10.894406 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8296404-d452-4b65-9ea9-423861d36e0a None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:10.945610 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:10.980595 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065f1696-6910-4a3d-9001-afde4e1d1621 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:11.036459 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad939b4c-e99e-46ae-bcc5-03eb4d0d1471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:11.037839 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad939b4c-e99e-46ae-bcc5-03eb4d0d1471 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:11.038323 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad939b4c-e99e-46ae-bcc5-03eb4d0d1471 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:11.038784 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad939b4c-e99e-46ae-bcc5-03eb4d0d1471 None admin] PATH_INFO: `/v3/projects` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:11.038989 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8296404-d452-4b65-9ea9-423861d36e0a None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:11.040187 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad939b4c-e99e-46ae-bcc5-03eb4d0d1471 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:11.041042 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad939b4c-e99e-46ae-bcc5-03eb4d0d1471 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:11.044078 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad939b4c-e99e-46ae-bcc5-03eb4d0d1471 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:11.068368 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 276/528] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Sep 18 00:43:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:11.074182 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad939b4c-e99e-46ae-bcc5-03eb4d0d1471 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:11.083206 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464f7621-c460-46a8-9230-8b7f4adfabaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:11.084053 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f7621-c460-46a8-9230-8b7f4adfabaf None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:11.084481 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f7621-c460-46a8-9230-8b7f4adfabaf None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:11.084936 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f7621-c460-46a8-9230-8b7f4adfabaf None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:11.085959 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464f7621-c460-46a8-9230-8b7f4adfabaf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:11.086400 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464f7621-c460-46a8-9230-8b7f4adfabaf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:11.088328 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464f7621-c460-46a8-9230-8b7f4adfabaf None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:11.111576 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 253/529] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Sep 18 00:43:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:11.113275 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464f7621-c460-46a8-9230-8b7f4adfabaf None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:11.150210 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:11.213833 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad939b4c-e99e-46ae-bcc5-03eb4d0d1471 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:11.248643 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464f7621-c460-46a8-9230-8b7f4adfabaf None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:11.256863 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd421dbb-2c58-407d-ab4b-14f162838845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:11.257485 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd421dbb-2c58-407d-ab4b-14f162838845 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:11.257763 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd421dbb-2c58-407d-ab4b-14f162838845 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:11.258032 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd421dbb-2c58-407d-ab4b-14f162838845 None admin] PATH_INFO: `/v3/users` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:11.258764 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd421dbb-2c58-407d-ab4b-14f162838845 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:11.259066 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd421dbb-2c58-407d-ab4b-14f162838845 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:11.260560 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd421dbb-2c58-407d-ab4b-14f162838845 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:11.263175 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:11.289739 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 277/530] 10.222.0.15 () {56 vars in 1139 bytes} [Sun Sep 18 00:43:11 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:11.289739 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd421dbb-2c58-407d-ab4b-14f162838845 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:11.310583 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3de04cb-a078-45ff-9d41-d1b98fd6f1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:11.311303 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de04cb-a078-45ff-9d41-d1b98fd6f1e9 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:11.311557 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de04cb-a078-45ff-9d41-d1b98fd6f1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:11.311793 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de04cb-a078-45ff-9d41-d1b98fd6f1e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:11.320647 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3de04cb-a078-45ff-9d41-d1b98fd6f1e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:11.322464 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3de04cb-a078-45ff-9d41-d1b98fd6f1e9 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:11.338502 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-b3de04cb-a078-45ff-9d41-d1b98fd6f1e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:43:11.338502 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:11.338502 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:11.338502 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:11.338502 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:11.338502 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:11.338502 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:11.338502 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:11.338502 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:11.338502 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:11.338502 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:11.338502 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:11.338502 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 00:43:11.338502 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 00:43:11.338502 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 00:43:11.340258 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 00:43:11.340258 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:11.340258 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:11.340258 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:11.340258 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:11.340258 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:11.340258 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:11.340258 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:11.340258 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:11.340258 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:11.340258 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:11.340258 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:11.340258 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:11.340258 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:11.340258 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:11.340258 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:11.340258 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:11.341927 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 00:43:11.341927 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 00:43:11.341927 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 00:43:11.341927 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 00:43:11.341927 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 00:43:11.341927 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 00:43:11.341927 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:43:11.341927 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:11.341927 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 254/531] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Sep 18 00:43:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:11.341927 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3de04cb-a078-45ff-9d41-d1b98fd6f1e9 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:11.430598 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd421dbb-2c58-407d-ab4b-14f162838845 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:11.469618 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:11.479309 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87af5374-33cc-4b46-9b0b-1f213b32fdd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:11.480970 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af5374-33cc-4b46-9b0b-1f213b32fdd2 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:11.481540 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af5374-33cc-4b46-9b0b-1f213b32fdd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:11.482078 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af5374-33cc-4b46-9b0b-1f213b32fdd2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:11.483194 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87af5374-33cc-4b46-9b0b-1f213b32fdd2 None admin] RBAC: Adding query filter params (role.id=5e91422b372b43749fe857ffd7bba774, scope.project.id=52ebde8fa3f84ede9ef575f7c0780798, user.id=292700152741419f9f9a945f7587769a) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:11.483856 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87af5374-33cc-4b46-9b0b-1f213b32fdd2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:11.485766 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87af5374-33cc-4b46-9b0b-1f213b32fdd2 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:11.486953 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3de04cb-a078-45ff-9d41-d1b98fd6f1e9 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:11.494736 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 278/532] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Sep 18 00:43:11 2022] GET /identity/v3/role_assignments?user.id=292700152741419f9f9a945f7587769a&scope.project.id=52ebde8fa3f84ede9ef575f7c0780798&role.id=5e91422b372b43749fe857ffd7bba774 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:11.496779 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87af5374-33cc-4b46-9b0b-1f213b32fdd2 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:11.571487 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549a2683-d336-4b30-83c0-8afdd43d45c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:11.572909 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a2683-d336-4b30-83c0-8afdd43d45c4 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:11.573365 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a2683-d336-4b30-83c0-8afdd43d45c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:11.573792 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a2683-d336-4b30-83c0-8afdd43d45c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:11.575185 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:11.577563 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549a2683-d336-4b30-83c0-8afdd43d45c4 None admin] RBAC: Adding query filter params (role.id=5e91422b372b43749fe857ffd7bba774, scope.project.id=52ebde8fa3f84ede9ef575f7c0780798, user.id=264c183fff8a49478eea4aceea73273e) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:11.578282 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549a2683-d336-4b30-83c0-8afdd43d45c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:11.582719 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549a2683-d336-4b30-83c0-8afdd43d45c4 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:11.600063 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 255/533] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Sep 18 00:43:11 2022] GET /identity/v3/role_assignments?user.id=264c183fff8a49478eea4aceea73273e&scope.project.id=52ebde8fa3f84ede9ef575f7c0780798&role.id=5e91422b372b43749fe857ffd7bba774 => generated 259 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:11.601572 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549a2683-d336-4b30-83c0-8afdd43d45c4 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:11.635185 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87af5374-33cc-4b46-9b0b-1f213b32fdd2 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:11.676974 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d793e8-49ff-4383-b48b-49b68f218a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:11.677988 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d793e8-49ff-4383-b48b-49b68f218a9b None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:11.678505 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d793e8-49ff-4383-b48b-49b68f218a9b None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:11.678986 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d793e8-49ff-4383-b48b-49b68f218a9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:11.765032 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d793e8-49ff-4383-b48b-49b68f218a9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:11.767075 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d793e8-49ff-4383-b48b-49b68f218a9b None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:11.829154 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549a2683-d336-4b30-83c0-8afdd43d45c4 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:11.838645 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:11.949574 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd815cca-294c-426b-bfe0-bd9636368e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:11.957143 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd815cca-294c-426b-bfe0-bd9636368e30 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:11.958148 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd815cca-294c-426b-bfe0-bd9636368e30 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:11.958916 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd815cca-294c-426b-bfe0-bd9636368e30 None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:11.960688 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd815cca-294c-426b-bfe0-bd9636368e30 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:11.961675 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd815cca-294c-426b-bfe0-bd9636368e30 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:11.974759 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 279/534] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Sep 18 00:43:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 00:43:11.975146 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd815cca-294c-426b-bfe0-bd9636368e30 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:11.984794 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d793e8-49ff-4383-b48b-49b68f218a9b None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:12.004853 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 256/535] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Sep 18 00:43:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:12.017814 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd815cca-294c-426b-bfe0-bd9636368e30 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:12.070214 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:12.197101 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d793e8-49ff-4383-b48b-49b68f218a9b None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:12.266131 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3830e4e6-6b3e-4f5b-9ffe-17c78eeb2464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:12.267245 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830e4e6-6b3e-4f5b-9ffe-17c78eeb2464 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:12.267723 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830e4e6-6b3e-4f5b-9ffe-17c78eeb2464 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:12.268332 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830e4e6-6b3e-4f5b-9ffe-17c78eeb2464 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:12.303078 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3830e4e6-6b3e-4f5b-9ffe-17c78eeb2464 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:12.305833 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3830e4e6-6b3e-4f5b-9ffe-17c78eeb2464 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:12.357466 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-3830e4e6-6b3e-4f5b-9ffe-17c78eeb2464 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:12.357466 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:12.357466 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:12.357466 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:12.357466 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:12.357466 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:12.357466 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:12.357466 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:12.357466 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:12.357466 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:12.357466 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:12.357466 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:12.357466 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:43:12.357466 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:43:12.357466 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:43:12.357466 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:43:12.359308 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:12.359308 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:12.359308 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:12.359308 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:12.359308 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:12.359308 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:12.359308 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:12.359308 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:12.359308 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:12.359308 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:12.359308 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:12.359308 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:12.359308 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:12.359308 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:12.359308 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:12.359308 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:12.359308 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:43:12.360955 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:43:12.360955 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:12.360955 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:12.360955 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 280/536] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:43:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:12.369371 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3830e4e6-6b3e-4f5b-9ffe-17c78eeb2464 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:12.382238 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd815cca-294c-426b-bfe0-bd9636368e30 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:12.400531 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:12.540822 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbd1ec4-d0b6-42e5-8bf6-1009e96f2fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:12.541349 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd1ec4-d0b6-42e5-8bf6-1009e96f2fbc None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:12.541888 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd1ec4-d0b6-42e5-8bf6-1009e96f2fbc None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:12.542163 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd1ec4-d0b6-42e5-8bf6-1009e96f2fbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:12.542913 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbd1ec4-d0b6-42e5-8bf6-1009e96f2fbc None admin] RBAC: Adding query filter params (role.id=5e91422b372b43749fe857ffd7bba774, scope.project.id=52ebde8fa3f84ede9ef575f7c0780798, user.id=6dbec16b81004ad3b4563ccc83d85c69) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:12.543223 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbd1ec4-d0b6-42e5-8bf6-1009e96f2fbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:12.544749 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbd1ec4-d0b6-42e5-8bf6-1009e96f2fbc None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:12.566146 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 257/537] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Sep 18 00:43:12 2022] GET /identity/v3/role_assignments?user.id=6dbec16b81004ad3b4563ccc83d85c69&scope.project.id=52ebde8fa3f84ede9ef575f7c0780798&role.id=5e91422b372b43749fe857ffd7bba774 => generated 259 bytes in 549 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:12.569436 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3830e4e6-6b3e-4f5b-9ffe-17c78eeb2464 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:12.662726 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651154c4-aceb-403a-89f3-af8c8176c394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:12.663875 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651154c4-aceb-403a-89f3-af8c8176c394 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:12.664401 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651154c4-aceb-403a-89f3-af8c8176c394 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:12.664886 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651154c4-aceb-403a-89f3-af8c8176c394 None admin] PATH_INFO: `/v3/domains` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:12.666039 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651154c4-aceb-403a-89f3-af8c8176c394 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:12.666815 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651154c4-aceb-403a-89f3-af8c8176c394 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:12.673852 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651154c4-aceb-403a-89f3-af8c8176c394 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:12.701365 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 281/538] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:43:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:43:12.710440 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbd1ec4-d0b6-42e5-8bf6-1009e96f2fbc None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:12.842749 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:12.879062 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbd1ec4-d0b6-42e5-8bf6-1009e96f2fbc None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:12.939694 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122a8418-9f12-48bd-85b6-6f036d686d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:12.941486 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a8418-9f12-48bd-85b6-6f036d686d76 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:12.942027 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a8418-9f12-48bd-85b6-6f036d686d76 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:12.942522 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a8418-9f12-48bd-85b6-6f036d686d76 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:12.955637 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122a8418-9f12-48bd-85b6-6f036d686d76 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:12.958479 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122a8418-9f12-48bd-85b6-6f036d686d76 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:12.982386 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-122a8418-9f12-48bd-85b6-6f036d686d76 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:43:12.982386 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:12.982386 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:12.982386 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:12.982386 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:12.982386 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:12.982386 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:12.982386 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:12.982386 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:12.982386 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:12.982386 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:12.982386 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:12.982386 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 00:43:12.982386 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 00:43:12.982386 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 00:43:12.983555 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 00:43:12.983555 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:12.983555 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:12.983555 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:12.983555 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:12.983555 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:12.983555 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:12.983555 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:12.983555 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:12.983555 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:12.983555 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:12.983555 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:12.983555 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:12.983555 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:12.983555 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:12.983555 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:12.983555 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:12.985786 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 00:43:12.985786 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 00:43:12.985786 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 00:43:12.985786 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 00:43:12.985786 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 00:43:12.985786 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 00:43:12.985786 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:43:12.985786 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:12.985786 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 258/539] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Sep 18 00:43:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:12.995749 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651154c4-aceb-403a-89f3-af8c8176c394 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:13.121531 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:13.165636 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651154c4-aceb-403a-89f3-af8c8176c394 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:13.205975 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88caac5f-27c2-4f47-9492-00685650817f None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:13.207013 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88caac5f-27c2-4f47-9492-00685650817f None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:13.207478 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88caac5f-27c2-4f47-9492-00685650817f None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:13.210431 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 259/540] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:43:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:43:13.217183 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805fee74-e21e-4d64-9e3e-b25d373553fa None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:13.217744 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805fee74-e21e-4d64-9e3e-b25d373553fa None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:13.218190 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805fee74-e21e-4d64-9e3e-b25d373553fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:13.231444 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca95f0-f09e-4980-b27c-bcebca92ae8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:13.232780 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca95f0-f09e-4980-b27c-bcebca92ae8f None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:13.233261 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca95f0-f09e-4980-b27c-bcebca92ae8f None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:13.233701 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca95f0-f09e-4980-b27c-bcebca92ae8f None admin] PATH_INFO: `/v3/projects` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:13.234572 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ca95f0-f09e-4980-b27c-bcebca92ae8f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:13.240687 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ca95f0-f09e-4980-b27c-bcebca92ae8f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:13.243274 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ca95f0-f09e-4980-b27c-bcebca92ae8f None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:13.246650 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-805fee74-e21e-4d64-9e3e-b25d373553fa None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:43:13.248106 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-805fee74-e21e-4d64-9e3e-b25d373553fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:43:13.272787 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 282/541] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Sep 18 00:43:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:13.281773 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca95f0-f09e-4980-b27c-bcebca92ae8f None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:13.376970 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 260/542] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:43:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 18 00:43:13.466149 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca95f0-f09e-4980-b27c-bcebca92ae8f None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:13.516789 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:13.531119 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd522a4b-aa3e-44ac-bc1c-c31165b1e183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:13.532172 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd522a4b-aa3e-44ac-bc1c-c31165b1e183 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:13.532659 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd522a4b-aa3e-44ac-bc1c-c31165b1e183 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:13.533152 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd522a4b-aa3e-44ac-bc1c-c31165b1e183 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:13.534084 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd522a4b-aa3e-44ac-bc1c-c31165b1e183 None admin] RBAC: Adding query filter params (role.id=5e91422b372b43749fe857ffd7bba774, scope.project.id=52ebde8fa3f84ede9ef575f7c0780798, user.id=9e46cfbc3b604788a833a81befaaab06) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:13.534608 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd522a4b-aa3e-44ac-bc1c-c31165b1e183 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:13.536322 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd522a4b-aa3e-44ac-bc1c-c31165b1e183 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:13.545330 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 283/543] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Sep 18 00:43:13 2022] GET /identity/v3/role_assignments?user.id=9e46cfbc3b604788a833a81befaaab06&scope.project.id=52ebde8fa3f84ede9ef575f7c0780798&role.id=5e91422b372b43749fe857ffd7bba774 => generated 259 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:43:13.926064 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805fee74-e21e-4d64-9e3e-b25d373553fa None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:14.014209 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:14.062346 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805fee74-e21e-4d64-9e3e-b25d373553fa None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:14.116177 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ee1db-ebbc-43da-ac28-8d259ec329ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:14.116845 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ee1db-ebbc-43da-ac28-8d259ec329ed None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:14.117129 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ee1db-ebbc-43da-ac28-8d259ec329ed None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:14.117406 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ee1db-ebbc-43da-ac28-8d259ec329ed None admin] PATH_INFO: `/v3/roles/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:14.129356 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529ee1db-ebbc-43da-ac28-8d259ec329ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:43:14.134396 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-529ee1db-ebbc-43da-ac28-8d259ec329ed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 18 00:43:14.134396 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:14.134396 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:14.134396 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:14.134396 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:14.134396 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:14.134396 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:14.134396 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:14.134396 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:14.134396 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:14.134396 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:14.134396 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:14.134396 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:43:14.134396 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:43:14.134396 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:43:14.134396 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:43:14.135307 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:43:14.135307 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:43:14.135307 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:43:14.135307 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:43:14.135307 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:14.135307 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:14.135307 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:14.135307 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:14.135307 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:14.135307 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:14.135307 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:14.135307 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:14.135307 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:14.135307 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:14.135307 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:14.135307 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:14.136120 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:14.136120 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:14.136120 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:14.136120 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:14.136120 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:43:14.136120 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:43:14.136120 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:43:14.136120 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:43:14.136120 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:43:14.136120 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:43:14.136120 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 18 00:43:14.136120 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:14.137568 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 261/544] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Sep 18 00:43:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:14.149048 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd522a4b-aa3e-44ac-bc1c-c31165b1e183 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:14.295358 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd522a4b-aa3e-44ac-bc1c-c31165b1e183 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:14.354578 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a833c34-6bc3-4c38-97c8-cd95ff583436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:14.355207 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a833c34-6bc3-4c38-97c8-cd95ff583436 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:14.355495 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a833c34-6bc3-4c38-97c8-cd95ff583436 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:14.355768 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a833c34-6bc3-4c38-97c8-cd95ff583436 None admin] PATH_INFO: `/v3/roles` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:14.356484 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a833c34-6bc3-4c38-97c8-cd95ff583436 None admin] RBAC: Adding query filter params (name=service) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:14.356789 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a833c34-6bc3-4c38-97c8-cd95ff583436 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:14.358182 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a833c34-6bc3-4c38-97c8-cd95ff583436 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:14.371993 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 284/545] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Sep 18 00:43:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:14.377721 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ee1db-ebbc-43da-ac28-8d259ec329ed None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:14.527372 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ee1db-ebbc-43da-ac28-8d259ec329ed None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:14.571951 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:14.585071 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc894d-43eb-407f-818a-e3355e2d39b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:14.585746 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc894d-43eb-407f-818a-e3355e2d39b3 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:14.586030 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc894d-43eb-407f-818a-e3355e2d39b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:14.586311 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc894d-43eb-407f-818a-e3355e2d39b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:14.604767 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fc894d-43eb-407f-818a-e3355e2d39b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:14.606879 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fc894d-43eb-407f-818a-e3355e2d39b3 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:14.629485 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-82fc894d-43eb-407f-818a-e3355e2d39b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:14.629485 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:14.629485 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:14.629485 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:14.629485 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:14.629485 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:14.629485 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:14.629485 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:14.629485 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:14.629485 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:14.629485 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:14.629485 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:14.629485 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:43:14.629485 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:43:14.629485 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:43:14.629485 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:43:14.630910 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:14.630910 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:14.630910 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:14.630910 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:14.630910 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:14.630910 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:14.630910 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:14.630910 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:14.630910 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:14.630910 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:14.630910 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:14.630910 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:14.630910 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:14.630910 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:14.630910 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:14.630910 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:14.630910 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:43:14.633652 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:43:14.633652 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:14.633652 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:14.633652 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 262/546] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:43:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:14.637052 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a833c34-6bc3-4c38-97c8-cd95ff583436 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:14.748472 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:14.800456 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a833c34-6bc3-4c38-97c8-cd95ff583436 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:14.818020 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b2eb2-b68e-4c1f-8d24-3bec71fb11ab None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:14.818636 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b2eb2-b68e-4c1f-8d24-3bec71fb11ab None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:14.819112 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b2eb2-b68e-4c1f-8d24-3bec71fb11ab None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:14.821140 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 263/547] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:43:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:43:14.826850 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d2632-c18a-489a-be7a-51f75ce10b81 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:14.827398 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d2632-c18a-489a-be7a-51f75ce10b81 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:14.827874 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d2632-c18a-489a-be7a-51f75ce10b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:14.839917 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90d32f7-c1a8-47c0-918e-300489158640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:14.839917 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d32f7-c1a8-47c0-918e-300489158640 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:14.839917 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d32f7-c1a8-47c0-918e-300489158640 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:14.839917 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d32f7-c1a8-47c0-918e-300489158640 None admin] PATH_INFO: `/v3/domains` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:14.840802 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90d32f7-c1a8-47c0-918e-300489158640 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:14.840802 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90d32f7-c1a8-47c0-918e-300489158640 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:14.845635 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90d32f7-c1a8-47c0-918e-300489158640 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:14.862178 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 285/548] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:43:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:14.862625 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-762d2632-c18a-489a-be7a-51f75ce10b81 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:43:14.863958 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-762d2632-c18a-489a-be7a-51f75ce10b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:43:14.867926 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90d32f7-c1a8-47c0-918e-300489158640 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:14.948317 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 264/549] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:43:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 00:43:15.078932 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90d32f7-c1a8-47c0-918e-300489158640 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:15.096138 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:15.126372 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd516093-5b60-4103-923d-463e816ef189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:15.127023 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd516093-5b60-4103-923d-463e816ef189 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:15.127306 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd516093-5b60-4103-923d-463e816ef189 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:15.127586 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd516093-5b60-4103-923d-463e816ef189 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:15.136225 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd516093-5b60-4103-923d-463e816ef189 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:15.137748 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd516093-5b60-4103-923d-463e816ef189 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:15.150568 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-bd516093-5b60-4103-923d-463e816ef189 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 18 00:43:15.150568 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:15.150568 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:15.150568 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:15.150568 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:15.150568 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:15.150568 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:15.150568 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:15.150568 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:15.150568 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:15.150568 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:15.150568 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:15.150568 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 00:43:15.150568 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 00:43:15.150568 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 00:43:15.150568 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 00:43:15.151537 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:15.151537 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:15.151537 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 00:43:15.151537 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:43:15.151537 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 00:43:15.151537 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:43:15.151537 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:15.151537 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:15.151537 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:15.151537 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:15.151537 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:15.151537 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:15.151537 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:15.151537 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:15.151537 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:15.151537 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:15.151537 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:15.151537 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:15.152464 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:15.152464 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:15.152464 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 00:43:15.152464 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 00:43:15.152464 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 00:43:15.152464 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 00:43:15.152464 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 00:43:15.152464 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 00:43:15.152464 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 18 00:43:15.152464 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:15.156006 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 286/550] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Sep 18 00:43:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 00:43:15.160732 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d2632-c18a-489a-be7a-51f75ce10b81 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:15.211983 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29cdff-9c9b-4823-9b87-5e2b3633067c None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:15.212293 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29cdff-9c9b-4823-9b87-5e2b3633067c None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:15.212554 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29cdff-9c9b-4823-9b87-5e2b3633067c None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:15.214225 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 287/551] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:43:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 18 00:43:15.222085 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d2085-38a1-4bef-8f03-692b14cb28d4 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:15.222388 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d2085-38a1-4bef-8f03-692b14cb28d4 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:15.222645 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d2085-38a1-4bef-8f03-692b14cb28d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:15.251687 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-ee5d2085-38a1-4bef-8f03-692b14cb28d4 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:43:15.253060 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-ee5d2085-38a1-4bef-8f03-692b14cb28d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:43:15.328306 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d2632-c18a-489a-be7a-51f75ce10b81 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:15.333563 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 288/552] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:43:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 00:43:15.335260 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5d2085-38a1-4bef-8f03-692b14cb28d4 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:15.359335 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:15.449593 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e1ffa4-2adf-4dca-b635-290753e86f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:15.450256 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e1ffa4-2adf-4dca-b635-290753e86f2d None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:15.450494 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e1ffa4-2adf-4dca-b635-290753e86f2d None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:15.450764 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e1ffa4-2adf-4dca-b635-290753e86f2d None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:15.451498 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e1ffa4-2adf-4dca-b635-290753e86f2d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:15.451807 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e1ffa4-2adf-4dca-b635-290753e86f2d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:15.453286 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e1ffa4-2adf-4dca-b635-290753e86f2d None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:15.458879 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5d2085-38a1-4bef-8f03-692b14cb28d4 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:15.461835 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:15.495139 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 265/553] 10.222.0.15 () {56 vars in 1135 bytes} [Sun Sep 18 00:43:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:15.500990 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e1ffa4-2adf-4dca-b635-290753e86f2d None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:15.532294 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f50be-ed4e-40d3-a750-77e35e46c3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:15.533129 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f50be-ed4e-40d3-a750-77e35e46c3df None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:15.533508 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f50be-ed4e-40d3-a750-77e35e46c3df None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:15.533883 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f50be-ed4e-40d3-a750-77e35e46c3df None admin] PATH_INFO: `/v3/roles/service` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:15.561421 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87f50be-ed4e-40d3-a750-77e35e46c3df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:43:15.571183 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-f87f50be-ed4e-40d3-a750-77e35e46c3df None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 18 00:43:15.571183 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:15.571183 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:15.571183 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:15.571183 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:15.571183 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:15.571183 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:15.571183 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:15.571183 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:15.571183 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:15.571183 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:15.571183 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:15.571183 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:43:15.571183 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:43:15.571183 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:43:15.571183 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:43:15.572349 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:43:15.572349 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:43:15.572349 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:43:15.572349 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:43:15.572349 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:15.572349 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:15.572349 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:15.572349 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:15.572349 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:15.572349 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:15.572349 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:15.572349 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:15.572349 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:15.572349 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:15.572349 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:15.572349 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:15.573339 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:15.573339 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:15.573339 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:15.573339 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:15.573339 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:43:15.573339 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:43:15.573339 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:43:15.573339 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:43:15.573339 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:43:15.573339 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:43:15.573339 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 18 00:43:15.573339 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:15.575671 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 289/554] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Sep 18 00:43:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:15.580874 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f50be-ed4e-40d3-a750-77e35e46c3df None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:15.692646 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e1ffa4-2adf-4dca-b635-290753e86f2d None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:15.726581 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f50be-ed4e-40d3-a750-77e35e46c3df None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:15.741353 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48396f99-0241-4e92-949d-8c40e3fb2a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:15.742288 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48396f99-0241-4e92-949d-8c40e3fb2a4b None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:15.742737 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48396f99-0241-4e92-949d-8c40e3fb2a4b None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:15.743181 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48396f99-0241-4e92-949d-8c40e3fb2a4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:15.786319 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:15.794903 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121a23e2-6e91-4d14-ba6d-d0863ca766d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:15.796150 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a23e2-6e91-4d14-ba6d-d0863ca766d0 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:15.796745 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a23e2-6e91-4d14-ba6d-d0863ca766d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:15.798360 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a23e2-6e91-4d14-ba6d-d0863ca766d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:15.799375 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121a23e2-6e91-4d14-ba6d-d0863ca766d0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:15.800540 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121a23e2-6e91-4d14-ba6d-d0863ca766d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:15.804252 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121a23e2-6e91-4d14-ba6d-d0863ca766d0 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:15.824000 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 290/555] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Sep 18 00:43:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:15.827035 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121a23e2-6e91-4d14-ba6d-d0863ca766d0 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:15.838099 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48396f99-0241-4e92-949d-8c40e3fb2a4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:15.839816 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48396f99-0241-4e92-949d-8c40e3fb2a4b None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:15.882185 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:16.001900 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 266/556] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Sep 18 00:43:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 00:43:16.003338 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48396f99-0241-4e92-949d-8c40e3fb2a4b None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:16.004378 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121a23e2-6e91-4d14-ba6d-d0863ca766d0 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:16.070590 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c8b97e-32a3-41c1-9c0e-e8f4c855d5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:16.071649 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8b97e-32a3-41c1-9c0e-e8f4c855d5c8 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:16.072186 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8b97e-32a3-41c1-9c0e-e8f4c855d5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:16.072694 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8b97e-32a3-41c1-9c0e-e8f4c855d5c8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:16.089959 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:16.096060 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c8b97e-32a3-41c1-9c0e-e8f4c855d5c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:43:16.106480 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-21c8b97e-32a3-41c1-9c0e-e8f4c855d5c8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 18 00:43:16.106480 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:16.106480 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:16.106480 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:16.106480 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:16.106480 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:16.106480 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:16.106480 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:16.106480 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:16.106480 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:16.106480 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:16.106480 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:16.106480 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:43:16.106480 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:43:16.106480 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:43:16.106480 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:43:16.107742 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:43:16.107742 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:43:16.107742 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:43:16.107742 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:43:16.107742 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:16.107742 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:16.107742 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:16.107742 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:16.107742 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:16.107742 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:16.107742 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:16.107742 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:16.107742 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:16.107742 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:16.107742 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:16.107742 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:16.108706 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:16.108706 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:16.108706 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:16.108706 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:16.108706 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:43:16.108706 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:43:16.108706 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:43:16.108706 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:43:16.108706 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:43:16.108706 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:43:16.108706 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 18 00:43:16.108706 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:16.109330 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 291/557] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Sep 18 00:43:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:16.112715 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842dbc1f-f9c6-458e-a8d2-98ef294cc2bc None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:16.112715 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842dbc1f-f9c6-458e-a8d2-98ef294cc2bc None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:16.112952 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842dbc1f-f9c6-458e-a8d2-98ef294cc2bc None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:16.115647 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 292/558] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:43:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:43:16.117155 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842dbc1f-f9c6-458e-a8d2-98ef294cc2bc None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:16.147527 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48396f99-0241-4e92-949d-8c40e3fb2a4b None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:16.191704 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38771f0a-7f72-4e31-963c-60bb9d58bc38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:16.192392 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38771f0a-7f72-4e31-963c-60bb9d58bc38 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:16.192672 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38771f0a-7f72-4e31-963c-60bb9d58bc38 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:16.192957 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38771f0a-7f72-4e31-963c-60bb9d58bc38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:16.207404 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38771f0a-7f72-4e31-963c-60bb9d58bc38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:16.208961 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38771f0a-7f72-4e31-963c-60bb9d58bc38 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:16.229553 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-38771f0a-7f72-4e31-963c-60bb9d58bc38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:16.229553 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:16.229553 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:16.229553 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:16.229553 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:16.229553 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:16.229553 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:16.229553 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:16.229553 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:16.229553 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:16.229553 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:16.229553 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:16.229553 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:43:16.229553 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:43:16.229553 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:43:16.229553 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:43:16.231174 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:16.231174 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:16.231174 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:16.231174 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:16.231174 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:16.231174 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:16.231174 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:16.231174 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:16.231174 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:16.231174 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:16.231174 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:16.231174 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:16.231174 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:16.231174 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:16.231174 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:16.231174 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:16.231174 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:43:16.232938 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:43:16.232938 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:16.232938 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:16.232938 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 267/559] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:43:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:16.232938 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4a071-87fb-4f08-b898-66a849ba8028 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:16.232938 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4a071-87fb-4f08-b898-66a849ba8028 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:16.232938 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4a071-87fb-4f08-b898-66a849ba8028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:16.255122 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-a5a4a071-87fb-4f08-b898-66a849ba8028 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:43:16.256310 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-a5a4a071-87fb-4f08-b898-66a849ba8028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:43:16.293048 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:16.315154 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842dbc1f-f9c6-458e-a8d2-98ef294cc2bc None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:16.360979 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 268/560] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:43:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 00:43:16.361864 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a4a071-87fb-4f08-b898-66a849ba8028 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:16.379313 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe31a5b8-4150-4005-a0de-c3129076bfbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:16.380153 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31a5b8-4150-4005-a0de-c3129076bfbb None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:16.380291 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31a5b8-4150-4005-a0de-c3129076bfbb None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:16.380652 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31a5b8-4150-4005-a0de-c3129076bfbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:16.392956 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe31a5b8-4150-4005-a0de-c3129076bfbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:16.394934 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe31a5b8-4150-4005-a0de-c3129076bfbb None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:16.412172 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-fe31a5b8-4150-4005-a0de-c3129076bfbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:16.412172 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:16.412172 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:16.412172 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:16.412172 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:16.412172 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:16.412172 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:16.412172 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:16.412172 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:16.412172 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:16.412172 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:16.412172 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:16.412172 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:43:16.412172 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:43:16.412172 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:43:16.412172 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:43:16.413880 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:16.413880 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:16.413880 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:16.413880 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:16.413880 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:16.413880 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:16.413880 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:16.413880 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:16.413880 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:16.413880 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:16.413880 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:16.413880 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:16.413880 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:16.413880 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:16.413880 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:16.413880 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:16.413880 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:43:16.415624 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:43:16.415624 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:16.415624 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:16.415624 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 293/561] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:43:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:16.415624 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe31a5b8-4150-4005-a0de-c3129076bfbb None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:16.442529 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:16.540210 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a4a071-87fb-4f08-b898-66a849ba8028 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:16.561554 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe31a5b8-4150-4005-a0de-c3129076bfbb None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:16.602324 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73383e8-8f50-4e86-ab3d-11ae79155bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:16.603304 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73383e8-8f50-4e86-ab3d-11ae79155bd1 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:16.603715 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73383e8-8f50-4e86-ab3d-11ae79155bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:16.604182 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73383e8-8f50-4e86-ab3d-11ae79155bd1 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:16.605190 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73383e8-8f50-4e86-ab3d-11ae79155bd1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:16.605621 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73383e8-8f50-4e86-ab3d-11ae79155bd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:16.607437 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73383e8-8f50-4e86-ab3d-11ae79155bd1 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:16.612357 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9360e8a3-af40-4721-aedf-d35c54154120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:16.613407 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360e8a3-af40-4721-aedf-d35c54154120 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:16.614001 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360e8a3-af40-4721-aedf-d35c54154120 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:16.615298 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360e8a3-af40-4721-aedf-d35c54154120 None admin] PATH_INFO: `/v3/domains` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:16.616539 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9360e8a3-af40-4721-aedf-d35c54154120 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:16.617076 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9360e8a3-af40-4721-aedf-d35c54154120 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:16.619659 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9360e8a3-af40-4721-aedf-d35c54154120 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:16.624092 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 269/562] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Sep 18 00:43:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:16.626157 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c35f9-45d5-48e4-9a3c-54db9c8b19dc None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:16.626599 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c35f9-45d5-48e4-9a3c-54db9c8b19dc None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:16.627005 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c35f9-45d5-48e4-9a3c-54db9c8b19dc None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:16.632091 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 270/563] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:43:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:43:16.632091 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c35f9-45d5-48e4-9a3c-54db9c8b19dc None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:16.638549 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:16.648094 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 294/564] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:43:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:16.648094 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9360e8a3-af40-4721-aedf-d35c54154120 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:16.776340 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9360e8a3-af40-4721-aedf-d35c54154120 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:16.776655 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c35f9-45d5-48e4-9a3c-54db9c8b19dc None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:16.789020 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:16.823255 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad98d7-d57f-487e-aef7-aa933ba8e1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:16.824237 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad98d7-d57f-487e-aef7-aa933ba8e1fb None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:16.824532 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad98d7-d57f-487e-aef7-aa933ba8e1fb None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:16.824813 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad98d7-d57f-487e-aef7-aa933ba8e1fb None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:16.825493 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccad98d7-d57f-487e-aef7-aa933ba8e1fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:16.825804 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccad98d7-d57f-487e-aef7-aa933ba8e1fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:16.827223 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccad98d7-d57f-487e-aef7-aa933ba8e1fb None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:16.833615 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f380c-c212-4508-b4d4-d1d1ae987432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:16.834412 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f380c-c212-4508-b4d4-d1d1ae987432 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:16.834847 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f380c-c212-4508-b4d4-d1d1ae987432 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:16.835882 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f380c-c212-4508-b4d4-d1d1ae987432 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:16.840533 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 271/565] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:43:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:16.841835 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5d347-5bbb-4079-8269-cce23d808284 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:16.842129 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5d347-5bbb-4079-8269-cce23d808284 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:16.842406 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5d347-5bbb-4079-8269-cce23d808284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:16.853649 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2f380c-c212-4508-b4d4-d1d1ae987432 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:16.856234 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2f380c-c212-4508-b4d4-d1d1ae987432 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:16.867280 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-f5e5d347-5bbb-4079-8269-cce23d808284 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:43:16.869084 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-f5e5d347-5bbb-4079-8269-cce23d808284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:43:16.881955 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-ae2f380c-c212-4508-b4d4-d1d1ae987432 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:16.881955 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:16.881955 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:16.881955 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:16.881955 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:16.881955 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:16.881955 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:16.881955 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:16.881955 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:16.881955 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:16.881955 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:16.881955 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:16.881955 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:43:16.881955 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:43:16.881955 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:43:16.881955 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:43:16.883034 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:16.883034 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:16.883034 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:16.883034 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:16.883034 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:16.883034 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:16.883034 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:16.883034 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:16.883034 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:16.883034 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:16.883034 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:16.883034 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:16.883034 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:16.883034 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:16.883034 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:16.883034 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:16.883034 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:43:16.884156 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:43:16.884156 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:16.884156 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:16.884361 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 295/566] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:43:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:16.885807 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f380c-c212-4508-b4d4-d1d1ae987432 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:16.943185 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:16.988727 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 272/567] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:43:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 00:43:16.990074 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e5d347-5bbb-4079-8269-cce23d808284 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:17.009045 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f380c-c212-4508-b4d4-d1d1ae987432 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:17.075077 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c86a5e4-44e1-4cb1-a4f7-81dc6739a155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:17.076161 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c86a5e4-44e1-4cb1-a4f7-81dc6739a155 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:17.076719 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c86a5e4-44e1-4cb1-a4f7-81dc6739a155 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:17.077216 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c86a5e4-44e1-4cb1-a4f7-81dc6739a155 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:17.097987 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c86a5e4-44e1-4cb1-a4f7-81dc6739a155 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:43:17.108248 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-4c86a5e4-44e1-4cb1-a4f7-81dc6739a155 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 18 00:43:17.108248 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:17.108248 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:17.108248 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:17.108248 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:17.108248 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:17.108248 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:17.108248 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:17.108248 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:17.108248 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:17.108248 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:17.108248 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:17.108248 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:43:17.108248 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:43:17.108248 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:43:17.108248 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:43:17.109242 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:43:17.109242 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:43:17.109242 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:43:17.109242 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:43:17.109242 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:17.109242 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:17.109242 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:17.109242 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:17.109242 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:17.109242 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:17.109242 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:17.109242 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:17.109242 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:17.109242 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:17.109242 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:17.109242 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:17.110050 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:17.110050 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:17.110050 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:17.110050 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:17.110050 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:43:17.110050 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:43:17.110050 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:43:17.110050 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:43:17.110050 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:43:17.110050 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:43:17.110050 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 18 00:43:17.110050 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:17.110674 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 296/568] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Sep 18 00:43:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:17.111632 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c86a5e4-44e1-4cb1-a4f7-81dc6739a155 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:17.119684 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:17.125234 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e5d347-5bbb-4079-8269-cce23d808284 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:17.181579 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477506e6-bd75-4da2-b6d5-38a1909d871f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:17.182624 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477506e6-bd75-4da2-b6d5-38a1909d871f None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:17.183121 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477506e6-bd75-4da2-b6d5-38a1909d871f None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:17.183614 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477506e6-bd75-4da2-b6d5-38a1909d871f None admin] PATH_INFO: `/v3/users/glance` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:17.197553 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477506e6-bd75-4da2-b6d5-38a1909d871f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:17.200331 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477506e6-bd75-4da2-b6d5-38a1909d871f None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:17.224571 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-477506e6-bd75-4da2-b6d5-38a1909d871f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 18 00:43:17.224571 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:17.224571 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:17.224571 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:17.224571 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:17.224571 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:17.224571 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:17.224571 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:17.224571 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:17.224571 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:17.224571 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:17.224571 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:17.224571 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 00:43:17.224571 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 00:43:17.224571 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 00:43:17.224571 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 00:43:17.225594 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:17.225594 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:17.225594 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 00:43:17.225594 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:43:17.225594 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 00:43:17.225594 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:43:17.225594 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:17.225594 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:17.225594 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:17.225594 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:17.225594 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:17.225594 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:17.225594 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:17.225594 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:17.225594 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:17.225594 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:17.225594 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:17.225594 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:17.226523 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:17.226523 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:17.226523 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 00:43:17.226523 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 00:43:17.226523 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 00:43:17.226523 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 00:43:17.226523 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 00:43:17.226523 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 00:43:17.226523 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 18 00:43:17.226523 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:17.227047 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 273/569] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Sep 18 00:43:16 2022] GET /identity/v3/users/glance => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:17.228195 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477506e6-bd75-4da2-b6d5-38a1909d871f None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:17.308663 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c86a5e4-44e1-4cb1-a4f7-81dc6739a155 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:17.330633 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:17.363358 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477506e6-bd75-4da2-b6d5-38a1909d871f None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:17.373931 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5702cb6a-688d-475d-97d8-9fbd8e98ab4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:17.374579 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5702cb6a-688d-475d-97d8-9fbd8e98ab4a None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:17.374857 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5702cb6a-688d-475d-97d8-9fbd8e98ab4a None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:17.375136 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5702cb6a-688d-475d-97d8-9fbd8e98ab4a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:17.383745 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5702cb6a-688d-475d-97d8-9fbd8e98ab4a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:17.385252 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5702cb6a-688d-475d-97d8-9fbd8e98ab4a None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:17.398151 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-5702cb6a-688d-475d-97d8-9fbd8e98ab4a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:43:17.398151 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:17.398151 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:17.398151 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:17.398151 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:17.398151 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:17.398151 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:17.398151 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:17.398151 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:17.398151 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:17.398151 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:17.398151 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:17.398151 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 00:43:17.398151 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 00:43:17.398151 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 00:43:17.400128 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 00:43:17.400128 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:17.400128 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:17.400128 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:17.400128 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:17.400128 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:17.400128 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:17.400128 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:17.400128 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:17.400128 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:17.400128 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:17.400128 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:17.400128 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:17.400128 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:17.400128 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:17.400128 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:17.400128 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:17.401915 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 00:43:17.401915 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 00:43:17.401915 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 00:43:17.401915 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 00:43:17.401915 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 00:43:17.401915 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 00:43:17.401915 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:43:17.401915 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:17.407432 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 297/570] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Sep 18 00:43:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:17.407432 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5702cb6a-688d-475d-97d8-9fbd8e98ab4a None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:17.437794 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b416223-680b-4e66-a510-a77c336e79f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:17.439034 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b416223-680b-4e66-a510-a77c336e79f1 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:17.439657 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b416223-680b-4e66-a510-a77c336e79f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:17.440265 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b416223-680b-4e66-a510-a77c336e79f1 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:17.441925 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b416223-680b-4e66-a510-a77c336e79f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:17.442467 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b416223-680b-4e66-a510-a77c336e79f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:17.445039 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b416223-680b-4e66-a510-a77c336e79f1 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:17.469448 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 274/571] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:43:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:17.470931 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b416223-680b-4e66-a510-a77c336e79f1 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:17.504767 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:17.539232 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5702cb6a-688d-475d-97d8-9fbd8e98ab4a None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:17.582530 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e6d8f8-5e66-403d-a142-4f1f65fae994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:17.583180 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6d8f8-5e66-403d-a142-4f1f65fae994 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:17.583597 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6d8f8-5e66-403d-a142-4f1f65fae994 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:17.584092 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6d8f8-5e66-403d-a142-4f1f65fae994 None admin] PATH_INFO: `/v3/roles` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:17.585046 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e6d8f8-5e66-403d-a142-4f1f65fae994 None admin] RBAC: Adding query filter params (name=service) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:17.585497 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e6d8f8-5e66-403d-a142-4f1f65fae994 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:17.587107 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e6d8f8-5e66-403d-a142-4f1f65fae994 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:17.605951 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 298/572] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Sep 18 00:43:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:17.605951 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e6d8f8-5e66-403d-a142-4f1f65fae994 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:17.606410 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b416223-680b-4e66-a510-a77c336e79f1 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:17.644573 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:17.651810 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce41a38-1ae8-45fe-89e3-76a600096fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:17.652816 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce41a38-1ae8-45fe-89e3-76a600096fd9 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:17.653213 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce41a38-1ae8-45fe-89e3-76a600096fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:17.653605 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce41a38-1ae8-45fe-89e3-76a600096fd9 None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:17.654604 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce41a38-1ae8-45fe-89e3-76a600096fd9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:17.654995 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce41a38-1ae8-45fe-89e3-76a600096fd9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:17.656814 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce41a38-1ae8-45fe-89e3-76a600096fd9 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:17.685330 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 275/573] 10.222.0.15 () {56 vars in 1137 bytes} [Sun Sep 18 00:43:17 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:17.686761 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce41a38-1ae8-45fe-89e3-76a600096fd9 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:17.745491 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e6d8f8-5e66-403d-a142-4f1f65fae994 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:17.788370 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:17.788644 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d6734-30ed-433f-97a7-de746e5ec3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:17.789562 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d6734-30ed-433f-97a7-de746e5ec3c3 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:17.789795 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d6734-30ed-433f-97a7-de746e5ec3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:17.790402 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d6734-30ed-433f-97a7-de746e5ec3c3 None admin] PATH_INFO: `/v3/projects` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:17.792366 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474d6734-30ed-433f-97a7-de746e5ec3c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:17.792875 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474d6734-30ed-433f-97a7-de746e5ec3c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:17.796179 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474d6734-30ed-433f-97a7-de746e5ec3c3 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:17.817495 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 299/574] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Sep 18 00:43:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:17.818429 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d6734-30ed-433f-97a7-de746e5ec3c3 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:17.829150 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce41a38-1ae8-45fe-89e3-76a600096fd9 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:17.883565 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29db98c6-e1a5-4b45-8404-6d76e15ca99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:17.884334 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db98c6-e1a5-4b45-8404-6d76e15ca99b None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:17.884692 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db98c6-e1a5-4b45-8404-6d76e15ca99b None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:17.885053 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db98c6-e1a5-4b45-8404-6d76e15ca99b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:17.902694 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29db98c6-e1a5-4b45-8404-6d76e15ca99b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:43:17.911922 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-29db98c6-e1a5-4b45-8404-6d76e15ca99b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 18 00:43:17.911922 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:17.911922 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:17.911922 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:17.911922 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:17.911922 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:17.911922 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:17.911922 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:17.911922 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:17.911922 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:17.911922 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:17.911922 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:17.911922 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:43:17.911922 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:43:17.911922 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:43:17.911922 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:43:17.913734 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:43:17.913734 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:43:17.913734 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:43:17.913734 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:43:17.913734 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:17.913734 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:17.913734 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:17.913734 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:17.913734 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:17.913734 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:17.913734 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:17.913734 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:17.913734 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:17.913734 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:17.913734 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:17.913734 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:17.915344 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:17.915344 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:17.915344 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:17.915344 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:17.915344 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:43:17.915344 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:43:17.915344 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:43:17.915344 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:43:17.915344 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:43:17.915344 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:43:17.915344 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 18 00:43:17.915344 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:17.915344 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 276/575] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Sep 18 00:43:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:17.915344 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29db98c6-e1a5-4b45-8404-6d76e15ca99b None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:17.964640 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:17.977277 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d6734-30ed-433f-97a7-de746e5ec3c3 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:18.021324 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037ef0d0-0459-4522-b55f-1bc74367318b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:18.023019 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ef0d0-0459-4522-b55f-1bc74367318b None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:18.023517 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ef0d0-0459-4522-b55f-1bc74367318b None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:18.024035 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ef0d0-0459-4522-b55f-1bc74367318b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:18.039640 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037ef0d0-0459-4522-b55f-1bc74367318b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:18.042664 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037ef0d0-0459-4522-b55f-1bc74367318b None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:18.057806 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-037ef0d0-0459-4522-b55f-1bc74367318b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 18 00:43:18.057806 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:18.057806 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:18.057806 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:18.057806 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:18.057806 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:18.057806 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:18.057806 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:18.057806 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:18.057806 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:18.057806 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:18.057806 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:18.057806 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 00:43:18.057806 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 00:43:18.057806 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 00:43:18.057806 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 00:43:18.058795 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:18.058795 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:18.058795 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 00:43:18.058795 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:43:18.058795 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 00:43:18.058795 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:43:18.058795 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:18.058795 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:18.058795 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:18.058795 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:18.058795 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:18.058795 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:18.058795 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:18.058795 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:18.058795 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:18.058795 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:18.058795 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:18.058795 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:18.059746 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:18.059746 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:18.059746 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 00:43:18.059746 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 00:43:18.059746 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 00:43:18.059746 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 00:43:18.059746 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 00:43:18.059746 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 00:43:18.059746 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 18 00:43:18.059746 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:18.059746 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 300/576] 10.222.0.15 () {56 vars in 1093 bytes} [Sun Sep 18 00:43:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:18.060590 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037ef0d0-0459-4522-b55f-1bc74367318b None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:18.083392 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29db98c6-e1a5-4b45-8404-6d76e15ca99b None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:18.124010 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35abcff-2a51-4f12-9b6c-1e75e415f35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:18.125014 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35abcff-2a51-4f12-9b6c-1e75e415f35c None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:18.125484 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35abcff-2a51-4f12-9b6c-1e75e415f35c None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:18.125860 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35abcff-2a51-4f12-9b6c-1e75e415f35c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:18.134419 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:18.138751 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35abcff-2a51-4f12-9b6c-1e75e415f35c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:18.140837 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35abcff-2a51-4f12-9b6c-1e75e415f35c None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:18.158882 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-c35abcff-2a51-4f12-9b6c-1e75e415f35c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:18.158882 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:18.158882 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:18.158882 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:18.158882 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:18.158882 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:18.158882 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:18.158882 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:18.158882 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:18.158882 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:18.158882 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:18.158882 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:18.158882 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:43:18.158882 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:43:18.158882 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:43:18.158882 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:43:18.161502 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:18.161502 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:18.161502 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:18.161502 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:18.161502 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:18.161502 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:18.161502 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:18.161502 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:18.161502 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:18.161502 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:18.161502 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:18.161502 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:18.161502 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:18.161502 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:18.161502 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:18.161502 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:18.161502 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:43:18.163217 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:43:18.163217 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:18.163217 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:18.163217 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 277/577] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:43:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:18.163217 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35abcff-2a51-4f12-9b6c-1e75e415f35c None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:18.190073 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037ef0d0-0459-4522-b55f-1bc74367318b None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:18.238814 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c73890-cba7-471b-b267-b1946e3aab88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:18.239808 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c73890-cba7-471b-b267-b1946e3aab88 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:18.240301 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c73890-cba7-471b-b267-b1946e3aab88 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:18.240761 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c73890-cba7-471b-b267-b1946e3aab88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:18.258553 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c73890-cba7-471b-b267-b1946e3aab88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:18.261049 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c73890-cba7-471b-b267-b1946e3aab88 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:18.285434 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-f9c73890-cba7-471b-b267-b1946e3aab88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:18.285434 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:18.285434 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:18.285434 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:18.285434 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:18.285434 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:18.285434 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:18.285434 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:18.285434 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:18.285434 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:18.285434 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:18.285434 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:18.285434 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:43:18.285434 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:43:18.285434 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:43:18.285434 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:43:18.293001 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:18.293001 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:18.293001 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:18.293001 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:18.293001 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:18.293001 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:18.293001 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:18.293001 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:18.293001 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:18.293001 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:18.293001 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:18.293001 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:18.293001 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:18.293001 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:18.293001 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:18.293001 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:18.293001 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:43:18.294854 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:43:18.294854 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:18.294854 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:18.294854 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 301/578] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:43:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:18.294854 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c73890-cba7-471b-b267-b1946e3aab88 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:18.297412 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:18.313171 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35abcff-2a51-4f12-9b6c-1e75e415f35c None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:18.356426 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4236b9-0412-47b6-825b-37f0094a778c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:18.357329 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4236b9-0412-47b6-825b-37f0094a778c None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:18.357663 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4236b9-0412-47b6-825b-37f0094a778c None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:18.358036 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4236b9-0412-47b6-825b-37f0094a778c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:18.358888 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4236b9-0412-47b6-825b-37f0094a778c None admin] RBAC: Adding query filter params (role.id=5e91422b372b43749fe857ffd7bba774, scope.project.id=52ebde8fa3f84ede9ef575f7c0780798, user.id=d0f16f1f2cb8475d9d5c752f56c4b74d) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:18.359392 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4236b9-0412-47b6-825b-37f0094a778c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:18.361289 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4236b9-0412-47b6-825b-37f0094a778c None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:18.368517 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 278/579] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Sep 18 00:43:18 2022] GET /identity/v3/role_assignments?user.id=d0f16f1f2cb8475d9d5c752f56c4b74d&scope.project.id=52ebde8fa3f84ede9ef575f7c0780798&role.id=5e91422b372b43749fe857ffd7bba774 => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:18.369584 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4236b9-0412-47b6-825b-37f0094a778c None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:18.443480 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c73890-cba7-471b-b267-b1946e3aab88 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:18.481201 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:18.507371 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce85f3-1ca7-4c2a-b4e8-4c2c61571e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:18.508513 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce85f3-1ca7-4c2a-b4e8-4c2c61571e3d None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:18.509045 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce85f3-1ca7-4c2a-b4e8-4c2c61571e3d None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:18.509583 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce85f3-1ca7-4c2a-b4e8-4c2c61571e3d None admin] PATH_INFO: `/v3/roles` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:18.510798 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ce85f3-1ca7-4c2a-b4e8-4c2c61571e3d None admin] RBAC: Adding query filter params (name=service) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:18.511387 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ce85f3-1ca7-4c2a-b4e8-4c2c61571e3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:18.514031 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ce85f3-1ca7-4c2a-b4e8-4c2c61571e3d None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:18.530474 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 302/580] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Sep 18 00:43:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:18.532093 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce85f3-1ca7-4c2a-b4e8-4c2c61571e3d None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:18.555747 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4236b9-0412-47b6-825b-37f0094a778c None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:18.612818 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8a17f-9ff2-400c-8603-186ad4c6000a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:18.613820 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8a17f-9ff2-400c-8603-186ad4c6000a None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:18.614629 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8a17f-9ff2-400c-8603-186ad4c6000a None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:18.614805 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8a17f-9ff2-400c-8603-186ad4c6000a None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:18.615656 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e8a17f-9ff2-400c-8603-186ad4c6000a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:18.616126 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e8a17f-9ff2-400c-8603-186ad4c6000a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:18.617991 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e8a17f-9ff2-400c-8603-186ad4c6000a None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:18.638860 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:18.640816 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 279/581] 10.222.0.15 () {56 vars in 1133 bytes} [Sun Sep 18 00:43:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:18.648232 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8a17f-9ff2-400c-8603-186ad4c6000a None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:18.697141 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce85f3-1ca7-4c2a-b4e8-4c2c61571e3d None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:18.753627 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89502205-2f6c-4862-9544-e6a9b8efacd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:18.754251 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89502205-2f6c-4862-9544-e6a9b8efacd3 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:18.754531 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89502205-2f6c-4862-9544-e6a9b8efacd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:18.754807 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89502205-2f6c-4862-9544-e6a9b8efacd3 None admin] PATH_INFO: `/v3/domains` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:18.755458 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89502205-2f6c-4862-9544-e6a9b8efacd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:18.755768 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89502205-2f6c-4862-9544-e6a9b8efacd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:18.757202 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89502205-2f6c-4862-9544-e6a9b8efacd3 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:18.769988 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8a17f-9ff2-400c-8603-186ad4c6000a None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:18.770285 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 303/582] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:43:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:18.771076 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89502205-2f6c-4862-9544-e6a9b8efacd3 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:18.791800 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:18.830586 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d801da-e5cd-40b5-84c6-5831cd4e25f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:18.831875 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d801da-e5cd-40b5-84c6-5831cd4e25f1 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:18.832511 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d801da-e5cd-40b5-84c6-5831cd4e25f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:18.833102 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d801da-e5cd-40b5-84c6-5831cd4e25f1 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:18.834357 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d801da-e5cd-40b5-84c6-5831cd4e25f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:18.835023 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d801da-e5cd-40b5-84c6-5831cd4e25f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:18.837640 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d801da-e5cd-40b5-84c6-5831cd4e25f1 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:18.863860 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 280/583] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:43:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:18.863860 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d801da-e5cd-40b5-84c6-5831cd4e25f1 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:18.894799 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89502205-2f6c-4862-9544-e6a9b8efacd3 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:18.928774 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:18.944109 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb86ae43-5d3a-469e-b9ee-7e00ee3f5150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:18.945363 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb86ae43-5d3a-469e-b9ee-7e00ee3f5150 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:18.945724 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb86ae43-5d3a-469e-b9ee-7e00ee3f5150 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:18.946075 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb86ae43-5d3a-469e-b9ee-7e00ee3f5150 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:18.957839 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb86ae43-5d3a-469e-b9ee-7e00ee3f5150 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:18.959332 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb86ae43-5d3a-469e-b9ee-7e00ee3f5150 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:18.981279 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-eb86ae43-5d3a-469e-b9ee-7e00ee3f5150 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:18.981279 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:18.981279 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:18.981279 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:18.981279 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:18.981279 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:18.981279 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:18.981279 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:18.981279 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:18.981279 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:18.981279 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:18.981279 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:18.981279 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:43:18.981279 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:43:18.981279 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:43:18.981279 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:43:18.983049 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:18.983049 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:18.983049 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:18.983049 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:18.983049 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:18.983049 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:18.983049 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:18.983049 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:18.983049 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:18.983049 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:18.983049 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:18.983049 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:18.983049 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:18.983049 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:18.983049 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:18.983049 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:18.983049 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:43:18.984695 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:43:18.984695 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:18.984695 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:18.984695 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 304/584] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:43:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:18.984695 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb86ae43-5d3a-469e-b9ee-7e00ee3f5150 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:19.034770 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d801da-e5cd-40b5-84c6-5831cd4e25f1 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:19.085550 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa24cd-6b7a-4b63-8bd7-47ef0e7649a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:19.086546 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa24cd-6b7a-4b63-8bd7-47ef0e7649a7 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:19.087002 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa24cd-6b7a-4b63-8bd7-47ef0e7649a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:19.087460 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa24cd-6b7a-4b63-8bd7-47ef0e7649a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:19.106492 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fa24cd-6b7a-4b63-8bd7-47ef0e7649a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:19.108318 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fa24cd-6b7a-4b63-8bd7-47ef0e7649a7 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:19.126383 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-44fa24cd-6b7a-4b63-8bd7-47ef0e7649a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:19.126383 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:19.126383 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:19.126383 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:19.126383 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:19.126383 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:19.126383 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:19.126383 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:19.126383 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:19.126383 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:19.126383 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:19.126383 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:19.126383 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:43:19.126383 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:43:19.126383 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:43:19.126383 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:43:19.128390 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:19.128390 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:19.128390 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:19.128390 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:19.128390 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:19.128390 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:19.128390 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:19.128390 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:19.128390 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:19.128390 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:19.128390 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:19.128390 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:19.128390 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:19.128390 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:19.128390 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:19.128390 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:19.128390 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:43:19.130120 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:43:19.130120 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:19.130120 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:19.130120 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 281/585] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:43:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:19.130120 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa24cd-6b7a-4b63-8bd7-47ef0e7649a7 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:19.140825 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb86ae43-5d3a-469e-b9ee-7e00ee3f5150 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:19.170721 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:19.189608 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ca5f9-8f86-4dfc-98fc-496d31df0bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:19.190562 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ca5f9-8f86-4dfc-98fc-496d31df0bcc None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:19.191049 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ca5f9-8f86-4dfc-98fc-496d31df0bcc None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:19.191481 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ca5f9-8f86-4dfc-98fc-496d31df0bcc None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:19.200887 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608ca5f9-8f86-4dfc-98fc-496d31df0bcc None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:19.202810 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608ca5f9-8f86-4dfc-98fc-496d31df0bcc None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:19.217936 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-608ca5f9-8f86-4dfc-98fc-496d31df0bcc None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 18 00:43:19.217936 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:19.217936 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:19.217936 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:19.217936 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:19.217936 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:19.217936 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:19.217936 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:19.217936 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:19.217936 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:19.217936 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:19.217936 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:19.217936 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 00:43:19.217936 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 00:43:19.217936 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 00:43:19.217936 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 00:43:19.219948 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:19.219948 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:19.219948 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 00:43:19.219948 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:43:19.219948 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 00:43:19.219948 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:43:19.219948 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:19.219948 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:19.219948 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:19.219948 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:19.219948 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:19.219948 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:19.219948 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:19.219948 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:19.219948 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:19.219948 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:19.219948 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:19.219948 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:19.222135 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:19.222135 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:19.222135 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 00:43:19.222135 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 00:43:19.222135 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 00:43:19.222135 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 00:43:19.222135 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 00:43:19.222135 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 00:43:19.222135 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 18 00:43:19.222135 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:19.225870 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 305/586] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Sep 18 00:43:18 2022] GET /identity/v3/users/cinder => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:19.226950 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ca5f9-8f86-4dfc-98fc-496d31df0bcc None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:19.280645 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:19.330428 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa24cd-6b7a-4b63-8bd7-47ef0e7649a7 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:19.382366 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ca5f9-8f86-4dfc-98fc-496d31df0bcc None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:19.396018 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28578e75-2d8b-4f58-bd44-22253db7d7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:19.397854 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28578e75-2d8b-4f58-bd44-22253db7d7ec None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:19.398527 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28578e75-2d8b-4f58-bd44-22253db7d7ec None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:19.399180 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28578e75-2d8b-4f58-bd44-22253db7d7ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:19.412103 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28578e75-2d8b-4f58-bd44-22253db7d7ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:19.413990 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28578e75-2d8b-4f58-bd44-22253db7d7ec None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:19.429113 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-28578e75-2d8b-4f58-bd44-22253db7d7ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:43:19.429113 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:19.429113 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:19.429113 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:19.429113 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:19.429113 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:19.429113 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:19.429113 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:19.429113 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:19.429113 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:19.429113 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:19.429113 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:19.429113 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 00:43:19.429113 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 00:43:19.429113 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 00:43:19.431064 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 00:43:19.431064 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:19.431064 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:19.431064 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:19.431064 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:19.431064 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:19.431064 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:19.431064 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:19.431064 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:19.431064 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:19.431064 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:19.431064 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:19.431064 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:19.431064 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:19.431064 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:19.431064 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:19.431064 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:19.433048 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 00:43:19.433048 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 00:43:19.433048 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 00:43:19.433048 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 00:43:19.433048 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 00:43:19.433048 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 00:43:19.433048 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:43:19.433048 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:19.437221 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 282/587] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Sep 18 00:43:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:19.438296 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28578e75-2d8b-4f58-bd44-22253db7d7ec None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:19.456437 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75415f5d-245b-45ba-af23-03d7fe86c05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:19.457671 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75415f5d-245b-45ba-af23-03d7fe86c05d None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:19.458746 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75415f5d-245b-45ba-af23-03d7fe86c05d None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:19.459577 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75415f5d-245b-45ba-af23-03d7fe86c05d None admin] PATH_INFO: `/v3/domains` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:19.460729 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75415f5d-245b-45ba-af23-03d7fe86c05d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:19.461414 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75415f5d-245b-45ba-af23-03d7fe86c05d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:19.464517 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75415f5d-245b-45ba-af23-03d7fe86c05d None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:19.500072 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 306/588] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:43:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:19.500072 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75415f5d-245b-45ba-af23-03d7fe86c05d None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:19.583874 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:19.614681 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28578e75-2d8b-4f58-bd44-22253db7d7ec None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:19.625786 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:19.631594 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75415f5d-245b-45ba-af23-03d7fe86c05d None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:19.676303 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26563c6-eccf-443b-98cf-337227cedc36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:19.677176 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26563c6-eccf-443b-98cf-337227cedc36 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:19.677661 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26563c6-eccf-443b-98cf-337227cedc36 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:19.678073 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26563c6-eccf-443b-98cf-337227cedc36 None admin] PATH_INFO: `/v3/users` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:19.678699 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4610671f-4111-40c9-b687-9c4bc24f2941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:19.679143 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26563c6-eccf-443b-98cf-337227cedc36 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:19.679604 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26563c6-eccf-443b-98cf-337227cedc36 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:19.679781 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610671f-4111-40c9-b687-9c4bc24f2941 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:19.680263 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610671f-4111-40c9-b687-9c4bc24f2941 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:19.680753 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610671f-4111-40c9-b687-9c4bc24f2941 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:19.681686 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26563c6-eccf-443b-98cf-337227cedc36 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:19.682015 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4610671f-4111-40c9-b687-9c4bc24f2941 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:19.682573 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4610671f-4111-40c9-b687-9c4bc24f2941 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:19.685237 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4610671f-4111-40c9-b687-9c4bc24f2941 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:19.705345 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 283/589] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:43:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:19.706366 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 307/590] 10.222.0.15 () {56 vars in 1137 bytes} [Sun Sep 18 00:43:19 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:19.707497 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4610671f-4111-40c9-b687-9c4bc24f2941 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:19.707707 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26563c6-eccf-443b-98cf-337227cedc36 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:19.870872 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4610671f-4111-40c9-b687-9c4bc24f2941 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:19.916287 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26563c6-eccf-443b-98cf-337227cedc36 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:19.927042 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac8db92-0aef-44ff-b0d3-c8e5dea93fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:19.927884 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8db92-0aef-44ff-b0d3-c8e5dea93fd3 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:19.928350 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8db92-0aef-44ff-b0d3-c8e5dea93fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:19.928767 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8db92-0aef-44ff-b0d3-c8e5dea93fd3 None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:19.929706 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac8db92-0aef-44ff-b0d3-c8e5dea93fd3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:19.930209 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac8db92-0aef-44ff-b0d3-c8e5dea93fd3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:19.932310 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac8db92-0aef-44ff-b0d3-c8e5dea93fd3 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:19.956319 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 284/591] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Sep 18 00:43:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:19.957852 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac8db92-0aef-44ff-b0d3-c8e5dea93fd3 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:19.962558 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:19.983111 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf0d82-3757-403f-95c0-425f98b3bd43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:19.984237 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf0d82-3757-403f-95c0-425f98b3bd43 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:19.984767 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf0d82-3757-403f-95c0-425f98b3bd43 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:19.985233 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf0d82-3757-403f-95c0-425f98b3bd43 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:19.999513 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcf0d82-3757-403f-95c0-425f98b3bd43 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:20.002149 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcf0d82-3757-403f-95c0-425f98b3bd43 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:20.024721 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-2dcf0d82-3757-403f-95c0-425f98b3bd43 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 18 00:43:20.024721 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:20.024721 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:20.024721 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:20.024721 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:20.024721 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:20.024721 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:20.024721 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:20.024721 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:20.024721 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:20.024721 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:20.024721 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:20.024721 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 00:43:20.024721 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 00:43:20.024721 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 00:43:20.024721 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 00:43:20.026797 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:20.026797 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:20.026797 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 00:43:20.026797 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:43:20.026797 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 00:43:20.026797 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:43:20.026797 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:20.026797 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:20.026797 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:20.026797 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:20.026797 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:20.026797 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:20.026797 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:20.026797 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:20.026797 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:20.026797 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:20.026797 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:20.026797 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:20.028698 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:20.028698 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:20.028698 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 00:43:20.028698 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 00:43:20.028698 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 00:43:20.028698 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 00:43:20.028698 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 00:43:20.028698 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 00:43:20.028698 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 18 00:43:20.028698 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:20.028698 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 308/592] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Sep 18 00:43:19 2022] GET /identity/v3/users/neutron => generated 85 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:20.028698 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf0d82-3757-403f-95c0-425f98b3bd43 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:20.057529 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:20.159617 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac8db92-0aef-44ff-b0d3-c8e5dea93fd3 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:20.169207 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf0d82-3757-403f-95c0-425f98b3bd43 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:20.214819 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e780cbb5-3c2b-476b-841d-0cf16060f016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:20.216050 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780cbb5-3c2b-476b-841d-0cf16060f016 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:20.216749 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780cbb5-3c2b-476b-841d-0cf16060f016 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:20.217339 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780cbb5-3c2b-476b-841d-0cf16060f016 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:20.219010 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351168a0-e10b-4bf9-a861-5f4d0fd0b995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:20.220496 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351168a0-e10b-4bf9-a861-5f4d0fd0b995 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:20.221005 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351168a0-e10b-4bf9-a861-5f4d0fd0b995 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:20.222027 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351168a0-e10b-4bf9-a861-5f4d0fd0b995 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:20.234071 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e780cbb5-3c2b-476b-841d-0cf16060f016 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:20.236480 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e780cbb5-3c2b-476b-841d-0cf16060f016 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:20.237149 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351168a0-e10b-4bf9-a861-5f4d0fd0b995 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:20.240041 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351168a0-e10b-4bf9-a861-5f4d0fd0b995 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:20.257935 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-e780cbb5-3c2b-476b-841d-0cf16060f016 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:20.257935 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:20.257935 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:20.257935 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:20.257935 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:20.257935 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:20.257935 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:20.257935 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:20.257935 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:20.257935 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:20.257935 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:20.257935 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:20.257935 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:43:20.257935 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:43:20.257935 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:43:20.257935 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:43:20.259577 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:20.259577 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:20.259577 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:20.259577 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:20.259577 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:20.259577 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:20.259577 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:20.259577 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:20.259577 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:20.259577 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:20.259577 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:20.259577 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:20.259577 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:20.259577 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:20.259577 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:20.259577 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:20.259577 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:43:20.268817 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:43:20.268817 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:20.268817 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:20.269188 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-351168a0-e10b-4bf9-a861-5f4d0fd0b995 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:43:20.269188 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:20.269188 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:20.269188 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:20.269188 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:20.269188 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:20.269188 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:20.269188 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:20.269188 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:20.269188 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:20.269188 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:20.269188 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:20.269188 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 00:43:20.269188 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 00:43:20.269188 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 00:43:20.270651 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 00:43:20.270651 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:20.270651 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:20.270651 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:20.270651 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:20.270651 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:20.270651 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:20.270651 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:20.270651 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:20.270651 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:20.270651 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:20.270651 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:20.270651 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:20.270651 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:20.270651 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:20.270651 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:20.270651 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:20.282070 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 00:43:20.282070 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 00:43:20.282070 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 00:43:20.282070 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 00:43:20.282070 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 00:43:20.282070 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 00:43:20.282070 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:43:20.282070 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:20.283489 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 285/593] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:43:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:20.283693 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 309/594] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Sep 18 00:43:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:20.284398 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e780cbb5-3c2b-476b-841d-0cf16060f016 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:20.284603 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351168a0-e10b-4bf9-a861-5f4d0fd0b995 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:20.363424 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:20.427154 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:20.434565 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e780cbb5-3c2b-476b-841d-0cf16060f016 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:20.480330 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351168a0-e10b-4bf9-a861-5f4d0fd0b995 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:20.483461 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e3085-e50b-413a-9d7f-392484515084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:20.485574 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e3085-e50b-413a-9d7f-392484515084 None admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:20.485574 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e3085-e50b-413a-9d7f-392484515084 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:20.485574 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e3085-e50b-413a-9d7f-392484515084 None admin] PATH_INFO: `/v3/projects/52ebde8fa3f84ede9ef575f7c0780798/users/292700152741419f9f9a945f7587769a/roles/5e91422b372b43749fe857ffd7bba774` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:20.504650 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7e3085-e50b-413a-9d7f-392484515084 None admin] RBAC: Authorizing `identity:create_grant(project_id=52ebde8fa3f84ede9ef575f7c0780798, user_id=292700152741419f9f9a945f7587769a, role_id=5e91422b372b43749fe857ffd7bba774)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:20.506151 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7e3085-e50b-413a-9d7f-392484515084 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:20.526235 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 286/595] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Sep 18 00:43:20 2022] PUT /identity/v3/projects/52ebde8fa3f84ede9ef575f7c0780798/users/292700152741419f9f9a945f7587769a/roles/5e91422b372b43749fe857ffd7bba774 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 00:43:20.528314 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e3085-e50b-413a-9d7f-392484515084 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:20.553775 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4efbdc-e5c1-4ea6-8473-573f68a00257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:20.554424 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4efbdc-e5c1-4ea6-8473-573f68a00257 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:20.554713 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4efbdc-e5c1-4ea6-8473-573f68a00257 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:20.554985 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4efbdc-e5c1-4ea6-8473-573f68a00257 None admin] PATH_INFO: `/v3/users` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:20.555740 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4efbdc-e5c1-4ea6-8473-573f68a00257 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:20.556080 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4efbdc-e5c1-4ea6-8473-573f68a00257 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:20.557599 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4efbdc-e5c1-4ea6-8473-573f68a00257 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:20.588082 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 310/596] 10.222.0.15 () {56 vars in 1139 bytes} [Sun Sep 18 00:43:20 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:20.589483 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4efbdc-e5c1-4ea6-8473-573f68a00257 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:20.691831 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e3085-e50b-413a-9d7f-392484515084 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:20.701914 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:20.747968 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596164ec-c059-4acc-94ea-a7c33223aa26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:20.749739 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596164ec-c059-4acc-94ea-a7c33223aa26 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:20.750600 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596164ec-c059-4acc-94ea-a7c33223aa26 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:20.751386 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596164ec-c059-4acc-94ea-a7c33223aa26 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:20.753317 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596164ec-c059-4acc-94ea-a7c33223aa26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:20.754185 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596164ec-c059-4acc-94ea-a7c33223aa26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:20.757512 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596164ec-c059-4acc-94ea-a7c33223aa26 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:20.763815 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4efbdc-e5c1-4ea6-8473-573f68a00257 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:20.783774 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 287/597] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:43:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:20.786084 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596164ec-c059-4acc-94ea-a7c33223aa26 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:20.812830 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c408aca-8aae-424c-aaeb-5a0e73437e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:20.813831 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c408aca-8aae-424c-aaeb-5a0e73437e98 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:20.814300 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c408aca-8aae-424c-aaeb-5a0e73437e98 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:20.814768 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c408aca-8aae-424c-aaeb-5a0e73437e98 None admin] PATH_INFO: `/v3/projects` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:20.816590 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c408aca-8aae-424c-aaeb-5a0e73437e98 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:20.817184 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c408aca-8aae-424c-aaeb-5a0e73437e98 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:20.819686 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c408aca-8aae-424c-aaeb-5a0e73437e98 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:20.822211 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:20.842281 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 311/598] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Sep 18 00:43:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:20.843745 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c408aca-8aae-424c-aaeb-5a0e73437e98 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:20.975989 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596164ec-c059-4acc-94ea-a7c33223aa26 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:21.017685 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c408aca-8aae-424c-aaeb-5a0e73437e98 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:21.025950 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f01349b-df23-40b6-a284-0c043b91e4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:21.026958 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01349b-df23-40b6-a284-0c043b91e4c0 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:21.027461 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01349b-df23-40b6-a284-0c043b91e4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:21.028003 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01349b-df23-40b6-a284-0c043b91e4c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:21.049313 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f01349b-df23-40b6-a284-0c043b91e4c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:21.052770 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f01349b-df23-40b6-a284-0c043b91e4c0 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:21.073094 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b7ec42-e042-401b-803c-3d6011505e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:21.074165 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b7ec42-e042-401b-803c-3d6011505e9c None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:21.074673 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b7ec42-e042-401b-803c-3d6011505e9c None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:21.075031 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b7ec42-e042-401b-803c-3d6011505e9c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:21.076169 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-7f01349b-df23-40b6-a284-0c043b91e4c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:21.076169 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:21.076169 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:21.076169 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:21.076169 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:21.076169 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:21.076169 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:21.076169 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:21.076169 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:21.076169 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:21.076169 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:21.076169 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:21.076169 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:43:21.076169 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:43:21.076169 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:43:21.076169 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:43:21.077561 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:21.077561 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:21.077561 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:21.077561 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:21.077561 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:21.077561 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:21.077561 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:21.077561 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:21.077561 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:21.077561 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:21.077561 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:21.077561 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:21.077561 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:21.077561 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:21.077561 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:21.077561 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:21.077561 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:43:21.078510 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:43:21.078510 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:21.078510 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:21.082048 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 288/599] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:43:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:21.082973 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f01349b-df23-40b6-a284-0c043b91e4c0 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:21.089505 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b7ec42-e042-401b-803c-3d6011505e9c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:21.091937 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b7ec42-e042-401b-803c-3d6011505e9c None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:21.104637 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:21.115655 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-a1b7ec42-e042-401b-803c-3d6011505e9c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:43:21.115655 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:21.115655 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:21.115655 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:21.115655 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:21.115655 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:21.115655 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:21.115655 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:21.115655 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:21.115655 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:21.115655 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:21.115655 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:21.115655 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 00:43:21.115655 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 00:43:21.115655 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 00:43:21.116916 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 00:43:21.116916 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:21.116916 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:21.116916 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:21.116916 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:21.116916 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:21.116916 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:21.116916 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:21.116916 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:21.116916 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:21.116916 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:21.116916 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:21.116916 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:21.116916 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:21.116916 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:21.116916 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:21.116916 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:21.118290 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 00:43:21.118290 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 00:43:21.118290 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 00:43:21.118290 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 00:43:21.118290 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 00:43:21.118290 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 00:43:21.118290 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:43:21.118290 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:21.118290 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 312/600] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Sep 18 00:43:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:21.119885 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61da68-7409-471d-aa8d-ff999214983f None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:21.120343 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61da68-7409-471d-aa8d-ff999214983f None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:21.120843 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61da68-7409-471d-aa8d-ff999214983f None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:21.128222 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 313/601] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:43:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:43:21.128222 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61da68-7409-471d-aa8d-ff999214983f None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:21.197638 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:21.223366 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f01349b-df23-40b6-a284-0c043b91e4c0 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:21.260618 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7fa4ad-62a7-4279-8f69-88b8f61f3107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:21.261191 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7fa4ad-62a7-4279-8f69-88b8f61f3107 None admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:21.261516 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7fa4ad-62a7-4279-8f69-88b8f61f3107 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:21.261804 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7fa4ad-62a7-4279-8f69-88b8f61f3107 None admin] PATH_INFO: `/v3/projects/52ebde8fa3f84ede9ef575f7c0780798/users/264c183fff8a49478eea4aceea73273e/roles/5e91422b372b43749fe857ffd7bba774` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:21.275435 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61da68-7409-471d-aa8d-ff999214983f None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:21.278808 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7fa4ad-62a7-4279-8f69-88b8f61f3107 None admin] RBAC: Authorizing `identity:create_grant(project_id=52ebde8fa3f84ede9ef575f7c0780798, user_id=264c183fff8a49478eea4aceea73273e, role_id=5e91422b372b43749fe857ffd7bba774)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:21.280333 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7fa4ad-62a7-4279-8f69-88b8f61f3107 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:21.299042 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 289/602] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Sep 18 00:43:21 2022] PUT /identity/v3/projects/52ebde8fa3f84ede9ef575f7c0780798/users/264c183fff8a49478eea4aceea73273e/roles/5e91422b372b43749fe857ffd7bba774 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 00:43:21.300851 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7fa4ad-62a7-4279-8f69-88b8f61f3107 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:21.331335 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad4d1f5-b286-4607-8449-e54092e5d9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:21.332100 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4d1f5-b286-4607-8449-e54092e5d9d6 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:21.332490 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4d1f5-b286-4607-8449-e54092e5d9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:21.332773 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4d1f5-b286-4607-8449-e54092e5d9d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:21.333474 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad4d1f5-b286-4607-8449-e54092e5d9d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:21.333841 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad4d1f5-b286-4607-8449-e54092e5d9d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:21.335343 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad4d1f5-b286-4607-8449-e54092e5d9d6 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:21.364428 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 314/603] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:43:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:21.369661 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b58389-8d1f-4a5b-9c76-c09c8c6c4aaa None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:21.369965 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b58389-8d1f-4a5b-9c76-c09c8c6c4aaa None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:21.370243 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b58389-8d1f-4a5b-9c76-c09c8c6c4aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:21.399328 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-64b58389-8d1f-4a5b-9c76-c09c8c6c4aaa None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:43:21.401789 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-64b58389-8d1f-4a5b-9c76-c09c8c6c4aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:43:21.410978 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:21.454557 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7fa4ad-62a7-4279-8f69-88b8f61f3107 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:21.510940 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e29dc-f742-48d9-8b34-7fba06590cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:21.512658 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e29dc-f742-48d9-8b34-7fba06590cd4 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:21.513768 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e29dc-f742-48d9-8b34-7fba06590cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:21.514556 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e29dc-f742-48d9-8b34-7fba06590cd4 None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:21.515687 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30e29dc-f742-48d9-8b34-7fba06590cd4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:21.516266 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30e29dc-f742-48d9-8b34-7fba06590cd4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:21.518968 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30e29dc-f742-48d9-8b34-7fba06590cd4 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:21.528315 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 315/604] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:43:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 00:43:21.529359 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b58389-8d1f-4a5b-9c76-c09c8c6c4aaa None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:21.543527 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 290/605] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Sep 18 00:43:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:21.552214 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e29dc-f742-48d9-8b34-7fba06590cd4 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:21.611100 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:21.765765 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b58389-8d1f-4a5b-9c76-c09c8c6c4aaa None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:21.787561 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e29dc-f742-48d9-8b34-7fba06590cd4 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:21.845251 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:21.861739 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c553b6c3-a86f-446b-9d6b-deb1b7e838ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:21.863073 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c553b6c3-a86f-446b-9d6b-deb1b7e838ab None admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:21.863567 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c553b6c3-a86f-446b-9d6b-deb1b7e838ab None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:21.864182 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c553b6c3-a86f-446b-9d6b-deb1b7e838ab None admin] PATH_INFO: `/v3/projects/52ebde8fa3f84ede9ef575f7c0780798/users/6dbec16b81004ad3b4563ccc83d85c69/roles/5e91422b372b43749fe857ffd7bba774` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:21.868610 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d0408f-0a71-4dfb-9562-6b5e94d13f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:21.869512 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0408f-0a71-4dfb-9562-6b5e94d13f6a None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:21.869978 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0408f-0a71-4dfb-9562-6b5e94d13f6a None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:21.870453 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0408f-0a71-4dfb-9562-6b5e94d13f6a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:21.879012 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d0408f-0a71-4dfb-9562-6b5e94d13f6a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:21.880788 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d0408f-0a71-4dfb-9562-6b5e94d13f6a None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:21.892784 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c553b6c3-a86f-446b-9d6b-deb1b7e838ab None admin] RBAC: Authorizing `identity:create_grant(project_id=52ebde8fa3f84ede9ef575f7c0780798, user_id=6dbec16b81004ad3b4563ccc83d85c69, role_id=5e91422b372b43749fe857ffd7bba774)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:21.894199 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-b7d0408f-0a71-4dfb-9562-6b5e94d13f6a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:43:21.894199 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:21.894199 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:21.894199 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:21.894199 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:21.894199 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:21.894199 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:21.894199 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:21.894199 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:21.894199 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:21.894199 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:21.894199 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:21.894199 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 00:43:21.894199 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 00:43:21.894199 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 00:43:21.895236 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 00:43:21.895236 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:21.895236 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:21.895236 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:21.895236 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:21.895236 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:21.895236 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:21.895236 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:21.895236 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:21.895236 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:21.895236 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:21.895236 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:21.895236 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:21.895236 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:21.895236 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:21.895236 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:21.895236 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:21.896335 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 00:43:21.896335 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 00:43:21.896335 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 00:43:21.896335 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 00:43:21.896335 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 00:43:21.896335 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 00:43:21.896335 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:43:21.896335 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:21.897908 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c553b6c3-a86f-446b-9d6b-deb1b7e838ab None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:21.898805 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 316/606] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Sep 18 00:43:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:21.899813 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d0408f-0a71-4dfb-9562-6b5e94d13f6a None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:21.921834 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 291/607] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Sep 18 00:43:21 2022] PUT /identity/v3/projects/52ebde8fa3f84ede9ef575f7c0780798/users/6dbec16b81004ad3b4563ccc83d85c69/roles/5e91422b372b43749fe857ffd7bba774 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 00:43:21.923396 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c553b6c3-a86f-446b-9d6b-deb1b7e838ab None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:22.114022 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c553b6c3-a86f-446b-9d6b-deb1b7e838ab None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:22.175337 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d0408f-0a71-4dfb-9562-6b5e94d13f6a None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:22.177545 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b5784d-9215-4c8e-b886-7394735a65af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:22.178447 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5784d-9215-4c8e-b886-7394735a65af None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:22.178875 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5784d-9215-4c8e-b886-7394735a65af None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:22.179159 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5784d-9215-4c8e-b886-7394735a65af None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:22.180014 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b5784d-9215-4c8e-b886-7394735a65af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:22.180415 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b5784d-9215-4c8e-b886-7394735a65af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:22.183554 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b5784d-9215-4c8e-b886-7394735a65af None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:22.204667 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 292/608] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Sep 18 00:43:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:22.208415 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:22.212127 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b5784d-9215-4c8e-b886-7394735a65af None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:22.251728 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad31df-f892-4b50-8258-f9854edf3aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:22.252427 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad31df-f892-4b50-8258-f9854edf3aeb None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:22.252954 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad31df-f892-4b50-8258-f9854edf3aeb None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:22.253233 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad31df-f892-4b50-8258-f9854edf3aeb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:22.262965 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:22.279252 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ad31df-f892-4b50-8258-f9854edf3aeb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:43:22.287574 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-89ad31df-f892-4b50-8258-f9854edf3aeb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 18 00:43:22.287574 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:22.287574 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:22.287574 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:22.287574 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:22.287574 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:22.287574 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:22.287574 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:22.287574 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:22.287574 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:22.287574 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:22.287574 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:22.287574 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:43:22.287574 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:43:22.287574 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:43:22.287574 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:43:22.288613 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:43:22.288613 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:43:22.288613 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:43:22.288613 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:43:22.288613 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:22.288613 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:22.288613 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:22.288613 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:22.288613 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:22.288613 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:22.288613 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:22.288613 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:22.288613 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:22.288613 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:22.288613 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:22.288613 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:22.289429 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:22.289429 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:22.289429 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:22.289429 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:22.289429 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:43:22.289429 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:43:22.289429 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:43:22.289429 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:43:22.289429 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:43:22.289429 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:43:22.289429 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 18 00:43:22.289429 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:22.289429 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 317/609] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Sep 18 00:43:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 389 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:22.301764 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad31df-f892-4b50-8258-f9854edf3aeb None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:22.406528 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b5784d-9215-4c8e-b886-7394735a65af None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:22.477751 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce5bde-a8e8-4714-be74-ac8d63810617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:22.478850 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce5bde-a8e8-4714-be74-ac8d63810617 None admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:22.479332 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce5bde-a8e8-4714-be74-ac8d63810617 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:22.479814 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce5bde-a8e8-4714-be74-ac8d63810617 None admin] PATH_INFO: `/v3/projects/52ebde8fa3f84ede9ef575f7c0780798/users/9e46cfbc3b604788a833a81befaaab06/roles/5e91422b372b43749fe857ffd7bba774` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:22.516147 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ce5bde-a8e8-4714-be74-ac8d63810617 None admin] RBAC: Authorizing `identity:create_grant(project_id=52ebde8fa3f84ede9ef575f7c0780798, user_id=9e46cfbc3b604788a833a81befaaab06, role_id=5e91422b372b43749fe857ffd7bba774)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:22.521216 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ce5bde-a8e8-4714-be74-ac8d63810617 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:22.532208 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad31df-f892-4b50-8258-f9854edf3aeb None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:22.564785 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 293/610] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Sep 18 00:43:22 2022] PUT /identity/v3/projects/52ebde8fa3f84ede9ef575f7c0780798/users/9e46cfbc3b604788a833a81befaaab06/roles/5e91422b372b43749fe857ffd7bba774 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 18 00:43:22.624453 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc2c6f2-5f02-412f-afda-8cca7997abbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:22.625504 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2c6f2-5f02-412f-afda-8cca7997abbb None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:22.625990 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2c6f2-5f02-412f-afda-8cca7997abbb None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:22.626465 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2c6f2-5f02-412f-afda-8cca7997abbb None admin] PATH_INFO: `/v3/roles` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:22.627512 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc2c6f2-5f02-412f-afda-8cca7997abbb None admin] RBAC: Adding query filter params (name=service) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:22.628108 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc2c6f2-5f02-412f-afda-8cca7997abbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:22.629708 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc2c6f2-5f02-412f-afda-8cca7997abbb None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:22.647562 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 318/611] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Sep 18 00:43:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:43:22.653956 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce5bde-a8e8-4714-be74-ac8d63810617 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:22.783542 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:22.801603 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce5bde-a8e8-4714-be74-ac8d63810617 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:22.854336 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b34b7-eed8-40be-86f0-e3e2170a1d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:22.855289 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b34b7-eed8-40be-86f0-e3e2170a1d57 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:22.856027 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b34b7-eed8-40be-86f0-e3e2170a1d57 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:22.856517 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b34b7-eed8-40be-86f0-e3e2170a1d57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:22.870987 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21b34b7-eed8-40be-86f0-e3e2170a1d57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:22.873111 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21b34b7-eed8-40be-86f0-e3e2170a1d57 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:22.894100 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-d21b34b7-eed8-40be-86f0-e3e2170a1d57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:22.894100 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:22.894100 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:22.894100 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:22.894100 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:22.894100 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:22.894100 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:22.894100 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:22.894100 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:22.894100 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:22.894100 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:22.894100 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:22.894100 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:43:22.894100 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:43:22.894100 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:43:22.894100 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:43:22.895118 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:22.895118 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:22.895118 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:22.895118 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:22.895118 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:22.895118 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:22.895118 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:22.895118 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:22.895118 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:22.895118 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:22.895118 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:22.895118 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:22.895118 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:22.895118 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:22.895118 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:22.895118 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:22.895118 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:43:22.896016 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:43:22.896016 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:22.896016 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:22.896897 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 294/612] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:43:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:22.903518 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc2c6f2-5f02-412f-afda-8cca7997abbb None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:22.952660 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:23.061967 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc2c6f2-5f02-412f-afda-8cca7997abbb None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:23.107240 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2174d2a5-3eb9-4a79-bf13-c27f6db1c33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:23.107870 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2174d2a5-3eb9-4a79-bf13-c27f6db1c33f None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:23.108172 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2174d2a5-3eb9-4a79-bf13-c27f6db1c33f None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:23.108450 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2174d2a5-3eb9-4a79-bf13-c27f6db1c33f None admin] PATH_INFO: `/v3/domains` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:23.109109 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2174d2a5-3eb9-4a79-bf13-c27f6db1c33f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:23.109411 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2174d2a5-3eb9-4a79-bf13-c27f6db1c33f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:23.110789 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2174d2a5-3eb9-4a79-bf13-c27f6db1c33f None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:23.129264 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 319/613] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:43:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:23.135132 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b34b7-eed8-40be-86f0-e3e2170a1d57 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:23.233686 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd28d1f-9ef3-452d-9212-9b6304f6d5fe None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:23.234020 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd28d1f-9ef3-452d-9212-9b6304f6d5fe None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:23.234250 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd28d1f-9ef3-452d-9212-9b6304f6d5fe None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:23.235750 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 320/614] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:43:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:43:23.241688 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982af35-57d3-4f0a-8866-57ec3d73ebc7 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:23.242386 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982af35-57d3-4f0a-8866-57ec3d73ebc7 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:23.242864 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982af35-57d3-4f0a-8866-57ec3d73ebc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:23.263418 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-d982af35-57d3-4f0a-8866-57ec3d73ebc7 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:43:23.265153 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-d982af35-57d3-4f0a-8866-57ec3d73ebc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:43:23.330613 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b34b7-eed8-40be-86f0-e3e2170a1d57 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:23.403761 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 321/615] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:43:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 00:43:23.418182 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b50a0-33ae-49af-8d22-3eb63ff2f2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:23.419363 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b50a0-33ae-49af-8d22-3eb63ff2f2e6 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:23.419946 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b50a0-33ae-49af-8d22-3eb63ff2f2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:23.420520 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b50a0-33ae-49af-8d22-3eb63ff2f2e6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:23.436911 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59b50a0-33ae-49af-8d22-3eb63ff2f2e6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:23.439491 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59b50a0-33ae-49af-8d22-3eb63ff2f2e6 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:23.443792 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:23.456460 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-d59b50a0-33ae-49af-8d22-3eb63ff2f2e6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 18 00:43:23.456460 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:23.456460 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:23.456460 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:23.456460 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:23.456460 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:23.456460 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:23.456460 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:23.456460 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:23.456460 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:23.456460 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:23.456460 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:23.456460 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 00:43:23.456460 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 00:43:23.456460 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 00:43:23.456460 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 00:43:23.458245 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:23.458245 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:23.458245 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 00:43:23.458245 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:43:23.458245 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 00:43:23.458245 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:43:23.458245 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:23.458245 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:23.458245 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:23.458245 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:23.458245 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:23.458245 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:23.458245 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:23.458245 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:23.458245 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:23.458245 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:23.458245 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:23.458245 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:23.460052 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:23.460052 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:23.460052 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 00:43:23.460052 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 00:43:23.460052 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 00:43:23.460052 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 00:43:23.460052 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 00:43:23.460052 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 00:43:23.460052 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 18 00:43:23.460052 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:23.462580 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 295/616] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Sep 18 00:43:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:23.467671 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d982af35-57d3-4f0a-8866-57ec3d73ebc7 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:23.500864 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:23.620222 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d982af35-57d3-4f0a-8866-57ec3d73ebc7 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:23.667583 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1798a3d-ca58-4781-9b52-12b90bf957b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:23.668239 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1798a3d-ca58-4781-9b52-12b90bf957b8 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:23.668528 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1798a3d-ca58-4781-9b52-12b90bf957b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:23.668802 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1798a3d-ca58-4781-9b52-12b90bf957b8 None admin] PATH_INFO: `/v3/users` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:23.669538 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1798a3d-ca58-4781-9b52-12b90bf957b8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:23.669846 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1798a3d-ca58-4781-9b52-12b90bf957b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:23.671285 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1798a3d-ca58-4781-9b52-12b90bf957b8 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:23.691747 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 322/617] 10.222.0.15 () {56 vars in 1135 bytes} [Sun Sep 18 00:43:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:23.697556 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b50a0-33ae-49af-8d22-3eb63ff2f2e6 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:23.808280 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1798a3d-ca58-4781-9b52-12b90bf957b8 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:23.877008 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b50a0-33ae-49af-8d22-3eb63ff2f2e6 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:23.940503 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa87edf5-9a05-4bc0-9c0b-4b0a08657886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:23.941161 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87edf5-9a05-4bc0-9c0b-4b0a08657886 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:23.941438 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87edf5-9a05-4bc0-9c0b-4b0a08657886 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:23.941709 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87edf5-9a05-4bc0-9c0b-4b0a08657886 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:23.944014 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:23.967193 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa87edf5-9a05-4bc0-9c0b-4b0a08657886 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:23.970528 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa87edf5-9a05-4bc0-9c0b-4b0a08657886 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:24.004685 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-aa87edf5-9a05-4bc0-9c0b-4b0a08657886 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:24.004685 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:24.004685 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:24.004685 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:24.004685 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:24.004685 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:24.004685 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:24.004685 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:24.004685 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:24.004685 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:24.004685 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:24.004685 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:24.004685 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:43:24.004685 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:43:24.004685 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:43:24.004685 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:43:24.005683 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:24.005683 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:24.005683 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:24.005683 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:24.005683 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:24.005683 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:24.005683 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:24.005683 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:24.005683 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:24.005683 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:24.005683 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:24.005683 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:24.005683 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:24.005683 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:24.005683 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:24.005683 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:24.005683 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:43:24.006805 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:43:24.006805 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:24.006805 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:24.014173 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1798a3d-ca58-4781-9b52-12b90bf957b8 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:24.020804 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 296/618] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:43:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:24.022055 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa87edf5-9a05-4bc0-9c0b-4b0a08657886 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:24.106185 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7115d9-9b38-4272-bf8d-c77815aa8bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:24.106847 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7115d9-9b38-4272-bf8d-c77815aa8bfe None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:24.106983 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:24.107128 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7115d9-9b38-4272-bf8d-c77815aa8bfe None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:24.107394 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7115d9-9b38-4272-bf8d-c77815aa8bfe None admin] PATH_INFO: `/v3/roles/service` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:24.125973 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7115d9-9b38-4272-bf8d-c77815aa8bfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:43:24.131745 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-8e7115d9-9b38-4272-bf8d-c77815aa8bfe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 18 00:43:24.131745 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:24.131745 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:24.131745 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:24.131745 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:24.131745 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:24.131745 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:24.131745 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:24.131745 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:24.131745 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:24.131745 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:24.131745 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:24.131745 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:43:24.131745 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:43:24.131745 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:43:24.131745 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:43:24.132795 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:43:24.132795 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:43:24.132795 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:43:24.132795 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:43:24.132795 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:24.132795 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:24.132795 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:24.132795 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:24.132795 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:24.132795 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:24.132795 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:24.132795 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:24.132795 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:24.132795 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:24.132795 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:24.132795 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:24.133640 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:24.133640 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:24.133640 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:24.133640 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:24.133640 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:43:24.133640 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:43:24.133640 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:43:24.133640 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:43:24.133640 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:43:24.133640 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:43:24.133640 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 18 00:43:24.133640 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:24.133640 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 323/619] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Sep 18 00:43:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 00:43:24.135068 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f3b84-a1d0-48b8-a42e-9b925f190c8b None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:24.135432 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f3b84-a1d0-48b8-a42e-9b925f190c8b None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:24.135772 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f3b84-a1d0-48b8-a42e-9b925f190c8b None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:24.140021 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 324/620] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:43:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:43:24.141111 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f3b84-a1d0-48b8-a42e-9b925f190c8b None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:24.172828 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa87edf5-9a05-4bc0-9c0b-4b0a08657886 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:24.224036 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c30875-2923-41bc-ac7e-5af65e1cdec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:24.225543 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c30875-2923-41bc-ac7e-5af65e1cdec2 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:24.226672 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c30875-2923-41bc-ac7e-5af65e1cdec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:24.227591 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c30875-2923-41bc-ac7e-5af65e1cdec2 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:24.228852 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c30875-2923-41bc-ac7e-5af65e1cdec2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:24.229476 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c30875-2923-41bc-ac7e-5af65e1cdec2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:24.233842 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c30875-2923-41bc-ac7e-5af65e1cdec2 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:24.265226 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 297/621] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:43:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:24.267050 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ab80f-3c27-4e80-808d-8afdba32a726 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:24.267566 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ab80f-3c27-4e80-808d-8afdba32a726 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:24.268377 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ab80f-3c27-4e80-808d-8afdba32a726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:24.290159 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-ad4ab80f-3c27-4e80-808d-8afdba32a726 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:43:24.292327 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-ad4ab80f-3c27-4e80-808d-8afdba32a726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:43:24.301175 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f3b84-a1d0-48b8-a42e-9b925f190c8b None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:24.387479 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac65208-5f33-4a97-9c62-5b1a557cfff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:24.394494 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac65208-5f33-4a97-9c62-5b1a557cfff8 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:24.395480 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac65208-5f33-4a97-9c62-5b1a557cfff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:24.396148 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac65208-5f33-4a97-9c62-5b1a557cfff8 None admin] PATH_INFO: `/v3/roles` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:24.397421 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac65208-5f33-4a97-9c62-5b1a557cfff8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:24.398137 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac65208-5f33-4a97-9c62-5b1a557cfff8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:24.401023 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac65208-5f33-4a97-9c62-5b1a557cfff8 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:24.408485 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 298/622] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:43:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 00:43:24.410221 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4ab80f-3c27-4e80-808d-8afdba32a726 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:24.411566 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:24.433224 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 325/623] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Sep 18 00:43:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:24.439283 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac65208-5f33-4a97-9c62-5b1a557cfff8 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:24.536761 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:24.605168 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac65208-5f33-4a97-9c62-5b1a557cfff8 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:24.618396 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4ab80f-3c27-4e80-808d-8afdba32a726 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:24.648122 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1f4853-1ae4-417c-94c7-5f6ac92f1528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:24.648956 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f4853-1ae4-417c-94c7-5f6ac92f1528 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:24.649115 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f4853-1ae4-417c-94c7-5f6ac92f1528 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:24.649501 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f4853-1ae4-417c-94c7-5f6ac92f1528 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:24.658975 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9620fa-eb77-40f3-9e48-87920cf8bfb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:24.659879 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9620fa-eb77-40f3-9e48-87920cf8bfb8 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:24.660244 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9620fa-eb77-40f3-9e48-87920cf8bfb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:24.660531 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9620fa-eb77-40f3-9e48-87920cf8bfb8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:24.663342 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1f4853-1ae4-417c-94c7-5f6ac92f1528 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:24.664939 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1f4853-1ae4-417c-94c7-5f6ac92f1528 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:24.668607 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9620fa-eb77-40f3-9e48-87920cf8bfb8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:24.670136 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9620fa-eb77-40f3-9e48-87920cf8bfb8 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:24.682353 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-4d1f4853-1ae4-417c-94c7-5f6ac92f1528 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:24.682353 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:24.682353 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:24.682353 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:24.682353 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:24.682353 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:24.682353 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:24.682353 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:24.682353 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:24.682353 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:24.682353 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:24.682353 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:24.682353 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:43:24.682353 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:43:24.682353 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:43:24.682353 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:43:24.684312 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:24.684312 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:24.684312 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:24.684312 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:24.684312 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:24.684312 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:24.684312 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:24.684312 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:24.684312 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:24.684312 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:24.684312 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:24.684312 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:24.684312 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:24.684312 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:24.684312 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:24.684312 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:24.684312 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:43:24.687552 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:43:24.687552 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:24.687552 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:24.688078 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-1e9620fa-eb77-40f3-9e48-87920cf8bfb8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:43:24.688078 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:24.688078 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:24.688078 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:24.688078 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:24.688078 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:24.688078 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:24.688078 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:24.688078 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:24.688078 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:24.688078 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:24.688078 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:24.688078 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 00:43:24.688078 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 00:43:24.688078 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 00:43:24.690089 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 00:43:24.690089 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:24.690089 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:24.690089 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:24.690089 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:24.690089 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:24.690089 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:24.690089 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:24.690089 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:24.690089 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:24.690089 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:24.690089 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:24.690089 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:24.690089 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:24.690089 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:24.690089 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:24.690089 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:24.698910 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 00:43:24.698910 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 00:43:24.698910 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 00:43:24.698910 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 00:43:24.698910 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 00:43:24.698910 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 00:43:24.698910 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:43:24.698910 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:24.700587 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 326/624] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:43:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 00:43:24.700805 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 299/625] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Sep 18 00:43:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:24.701032 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47501179-d045-47ca-a427-4990d1f56226 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:24.701032 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47501179-d045-47ca-a427-4990d1f56226 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:24.701032 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47501179-d045-47ca-a427-4990d1f56226 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:24.701032 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 327/626] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:43:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:43:24.701829 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9620fa-eb77-40f3-9e48-87920cf8bfb8 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:24.702058 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47501179-d045-47ca-a427-4990d1f56226 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:24.760313 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:24.807876 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9620fa-eb77-40f3-9e48-87920cf8bfb8 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:24.809548 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:24.831692 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47501179-d045-47ca-a427-4990d1f56226 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:24.858320 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2cc53b-1bd9-423f-9784-e793ef84f07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:24.858943 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2cc53b-1bd9-423f-9784-e793ef84f07f None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:24.859224 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2cc53b-1bd9-423f-9784-e793ef84f07f None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:24.859500 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2cc53b-1bd9-423f-9784-e793ef84f07f None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:24.860236 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2cc53b-1bd9-423f-9784-e793ef84f07f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:24.860543 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2cc53b-1bd9-423f-9784-e793ef84f07f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:24.862083 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2cc53b-1bd9-423f-9784-e793ef84f07f None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:24.882785 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 300/627] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Sep 18 00:43:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:24.882785 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a034ba-30b8-46d7-8a86-828a22d72d88 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:24.882785 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a034ba-30b8-46d7-8a86-828a22d72d88 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:24.882785 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a034ba-30b8-46d7-8a86-828a22d72d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:24.897031 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-f5a034ba-30b8-46d7-8a86-828a22d72d88 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:43:24.898281 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199df9ed-5bb1-42d3-9876-a0fc91040a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:24.898482 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-f5a034ba-30b8-46d7-8a86-828a22d72d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:43:24.899159 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199df9ed-5bb1-42d3-9876-a0fc91040a8d None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:24.899484 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199df9ed-5bb1-42d3-9876-a0fc91040a8d None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:24.899765 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199df9ed-5bb1-42d3-9876-a0fc91040a8d None admin] PATH_INFO: `/v3/domains` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:24.901322 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199df9ed-5bb1-42d3-9876-a0fc91040a8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:24.901701 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199df9ed-5bb1-42d3-9876-a0fc91040a8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:24.904756 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199df9ed-5bb1-42d3-9876-a0fc91040a8d None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:24.924461 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 328/628] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:43:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:24.924461 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199df9ed-5bb1-42d3-9876-a0fc91040a8d None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:25.023927 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 301/629] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:43:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 00:43:25.023927 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a034ba-30b8-46d7-8a86-828a22d72d88 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:25.140387 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199df9ed-5bb1-42d3-9876-a0fc91040a8d None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:25.161457 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:25.210258 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:25.221242 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dc47e4-4277-4452-95f1-ca5dae9e5006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:25.222161 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc47e4-4277-4452-95f1-ca5dae9e5006 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:25.222598 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc47e4-4277-4452-95f1-ca5dae9e5006 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:25.223295 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc47e4-4277-4452-95f1-ca5dae9e5006 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:25.230124 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a034ba-30b8-46d7-8a86-828a22d72d88 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:25.239133 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dc47e4-4277-4452-95f1-ca5dae9e5006 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:43:25.244313 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-62dc47e4-4277-4452-95f1-ca5dae9e5006 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 18 00:43:25.244313 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:25.244313 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:25.244313 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:25.244313 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:25.244313 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:25.244313 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:25.244313 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:25.244313 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:25.244313 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:25.244313 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:25.244313 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:25.244313 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:43:25.244313 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:43:25.244313 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:43:25.244313 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:43:25.245282 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:43:25.245282 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:43:25.245282 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:43:25.245282 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:43:25.245282 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:25.245282 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:25.245282 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:25.245282 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:25.245282 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:25.245282 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:25.245282 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:25.245282 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:25.245282 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:25.245282 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:25.245282 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:25.245282 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:25.246102 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:25.246102 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:25.246102 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:25.246102 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:25.246102 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:43:25.246102 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:43:25.246102 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:43:25.246102 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:43:25.246102 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:43:25.246102 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:43:25.246102 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 18 00:43:25.246102 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:25.249164 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 329/630] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Sep 18 00:43:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:25.250356 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dc47e4-4277-4452-95f1-ca5dae9e5006 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:25.294621 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e59034e-efec-4f39-951a-8d9f47eabdda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:25.295750 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59034e-efec-4f39-951a-8d9f47eabdda None admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:25.296272 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59034e-efec-4f39-951a-8d9f47eabdda None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:25.296757 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59034e-efec-4f39-951a-8d9f47eabdda None admin] PATH_INFO: `/v3/projects/52ebde8fa3f84ede9ef575f7c0780798/users/d0f16f1f2cb8475d9d5c752f56c4b74d/roles/5e91422b372b43749fe857ffd7bba774` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:25.333096 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e59034e-efec-4f39-951a-8d9f47eabdda None admin] RBAC: Authorizing `identity:create_grant(project_id=52ebde8fa3f84ede9ef575f7c0780798, user_id=d0f16f1f2cb8475d9d5c752f56c4b74d, role_id=5e91422b372b43749fe857ffd7bba774)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:25.337488 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e59034e-efec-4f39-951a-8d9f47eabdda None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:25.368498 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 302/631] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Sep 18 00:43:25 2022] PUT /identity/v3/projects/52ebde8fa3f84ede9ef575f7c0780798/users/d0f16f1f2cb8475d9d5c752f56c4b74d/roles/5e91422b372b43749fe857ffd7bba774 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 00:43:25.375941 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e59034e-efec-4f39-951a-8d9f47eabdda None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:25.481071 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dc47e4-4277-4452-95f1-ca5dae9e5006 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:25.578658 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ea45b-2972-4cdd-9fc7-fa43f40b1031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:25.581381 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ea45b-2972-4cdd-9fc7-fa43f40b1031 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:25.581839 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ea45b-2972-4cdd-9fc7-fa43f40b1031 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:25.582578 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ea45b-2972-4cdd-9fc7-fa43f40b1031 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:25.600621 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9ea45b-2972-4cdd-9fc7-fa43f40b1031 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:25.603441 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9ea45b-2972-4cdd-9fc7-fa43f40b1031 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:25.605152 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e59034e-efec-4f39-951a-8d9f47eabdda None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:25.631287 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-ec9ea45b-2972-4cdd-9fc7-fa43f40b1031 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 18 00:43:25.631287 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:25.631287 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:25.631287 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:25.631287 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:25.631287 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:25.631287 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:25.631287 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:25.631287 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:25.631287 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:25.631287 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:25.631287 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:25.631287 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 00:43:25.631287 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 00:43:25.631287 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 00:43:25.631287 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 00:43:25.632777 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:25.632777 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:25.632777 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 00:43:25.632777 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:43:25.632777 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 00:43:25.632777 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:43:25.632777 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:25.632777 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:25.632777 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:25.632777 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:25.632777 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:25.632777 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:25.632777 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:25.632777 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:25.632777 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:25.632777 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:25.632777 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:25.632777 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:25.634448 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:25.634448 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:25.634448 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 00:43:25.634448 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 00:43:25.634448 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 00:43:25.634448 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 00:43:25.634448 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 00:43:25.634448 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 00:43:25.634448 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 18 00:43:25.634448 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:25.634448 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 330/632] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Sep 18 00:43:25 2022] GET /identity/v3/users/glance => generated 84 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:25.635497 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ea45b-2972-4cdd-9fc7-fa43f40b1031 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:25.680236 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:25.685350 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e9b0a-5e0e-4ac2-9d2b-584f5a7c5907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:25.686247 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e9b0a-5e0e-4ac2-9d2b-584f5a7c5907 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:25.686659 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e9b0a-5e0e-4ac2-9d2b-584f5a7c5907 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:25.687063 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e9b0a-5e0e-4ac2-9d2b-584f5a7c5907 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:25.688112 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210e9b0a-5e0e-4ac2-9d2b-584f5a7c5907 None admin] RBAC: Adding query filter params (name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:25.688544 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210e9b0a-5e0e-4ac2-9d2b-584f5a7c5907 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:25.691219 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210e9b0a-5e0e-4ac2-9d2b-584f5a7c5907 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:25.707289 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 303/633] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Sep 18 00:43:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:25.707289 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e9b0a-5e0e-4ac2-9d2b-584f5a7c5907 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:25.718364 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:25.803426 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ea45b-2972-4cdd-9fc7-fa43f40b1031 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:25.865850 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d58578-59ce-4e5a-bfcf-288984541c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:25.866924 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d58578-59ce-4e5a-bfcf-288984541c70 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:25.867411 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d58578-59ce-4e5a-bfcf-288984541c70 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:25.867931 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d58578-59ce-4e5a-bfcf-288984541c70 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:25.887253 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d58578-59ce-4e5a-bfcf-288984541c70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:43:25.894880 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e9b0a-5e0e-4ac2-9d2b-584f5a7c5907 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:25.898315 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-21d58578-59ce-4e5a-bfcf-288984541c70 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 18 00:43:25.898315 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:25.898315 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:25.898315 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:25.898315 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:25.898315 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:25.898315 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:25.898315 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:25.898315 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:25.898315 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:25.898315 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:25.898315 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:25.898315 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:43:25.898315 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:43:25.898315 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:43:25.898315 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:43:25.899236 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:43:25.899236 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:43:25.899236 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:43:25.899236 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:43:25.899236 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:25.899236 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:25.899236 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:25.899236 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:25.899236 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:25.899236 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:25.899236 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:25.899236 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:25.899236 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:25.899236 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:25.899236 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:25.899236 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:25.900103 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:25.900103 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:25.900103 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:25.900103 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:25.900103 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:43:25.900103 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:43:25.900103 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:43:25.900103 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:43:25.900103 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:43:25.900103 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:43:25.900103 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 18 00:43:25.900103 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:25.900790 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 331/634] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Sep 18 00:43:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:25.902826 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438ee1a-3e4d-4ed7-a7a2-9434daad9c6b None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:25.903278 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438ee1a-3e4d-4ed7-a7a2-9434daad9c6b None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:25.903762 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438ee1a-3e4d-4ed7-a7a2-9434daad9c6b None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:25.906923 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 332/635] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:43:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:43:25.908506 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c438ee1a-3e4d-4ed7-a7a2-9434daad9c6b None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:25.944722 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bbf05a-925c-40e5-8fca-77fc6e03f56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:25.945373 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bbf05a-925c-40e5-8fca-77fc6e03f56f None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:25.945660 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bbf05a-925c-40e5-8fca-77fc6e03f56f None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:25.945931 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bbf05a-925c-40e5-8fca-77fc6e03f56f None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:25.946663 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bbf05a-925c-40e5-8fca-77fc6e03f56f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:25.946970 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bbf05a-925c-40e5-8fca-77fc6e03f56f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:25.948476 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bbf05a-925c-40e5-8fca-77fc6e03f56f None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:25.978965 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 304/636] 10.222.0.15 () {56 vars in 1137 bytes} [Sun Sep 18 00:43:25 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:25.980890 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bbf05a-925c-40e5-8fca-77fc6e03f56f None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:26.074621 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:26.090243 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:26.101749 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c438ee1a-3e4d-4ed7-a7a2-9434daad9c6b None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:26.161638 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bbf05a-925c-40e5-8fca-77fc6e03f56f None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:26.164172 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa982593-9bfb-4b7e-99bd-4d6f54aa3832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:26.165150 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa982593-9bfb-4b7e-99bd-4d6f54aa3832 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:26.165606 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa982593-9bfb-4b7e-99bd-4d6f54aa3832 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:26.166047 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa982593-9bfb-4b7e-99bd-4d6f54aa3832 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:26.184870 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa982593-9bfb-4b7e-99bd-4d6f54aa3832 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:26.187508 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa982593-9bfb-4b7e-99bd-4d6f54aa3832 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:26.211656 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-fa982593-9bfb-4b7e-99bd-4d6f54aa3832 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:26.211656 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:26.211656 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:26.211656 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:26.211656 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:26.211656 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:26.211656 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:26.211656 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:26.211656 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:26.211656 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:26.211656 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:26.211656 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:26.211656 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:43:26.211656 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:43:26.211656 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:43:26.211656 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:43:26.213596 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:26.213596 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:26.213596 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:26.213596 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:26.213596 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:26.213596 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:26.213596 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:26.213596 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:26.213596 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:26.213596 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:26.213596 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:26.213596 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:26.213596 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:26.213596 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:26.213596 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:26.213596 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:26.213596 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:43:26.216018 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:43:26.216018 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:26.216018 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:26.219803 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 333/637] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:43:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:26.222045 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31436579-6365-4d68-9ccd-4611e6042d69 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:26.222481 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31436579-6365-4d68-9ccd-4611e6042d69 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:26.222936 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31436579-6365-4d68-9ccd-4611e6042d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:26.232592 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2f357b-4b91-44e7-9268-a6766478944b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:26.233648 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f357b-4b91-44e7-9268-a6766478944b None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:26.234158 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f357b-4b91-44e7-9268-a6766478944b None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:26.234642 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f357b-4b91-44e7-9268-a6766478944b None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:26.235928 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2f357b-4b91-44e7-9268-a6766478944b None admin] RBAC: Adding query filter params (name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:26.236430 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2f357b-4b91-44e7-9268-a6766478944b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:26.239458 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2f357b-4b91-44e7-9268-a6766478944b None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:26.247290 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-31436579-6365-4d68-9ccd-4611e6042d69 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:43:26.248962 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-31436579-6365-4d68-9ccd-4611e6042d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:43:26.255632 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 305/638] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Sep 18 00:43:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:26.257597 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2f357b-4b91-44e7-9268-a6766478944b None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:26.355379 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 334/639] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:43:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 00:43:26.357486 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31436579-6365-4d68-9ccd-4611e6042d69 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:26.487921 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2f357b-4b91-44e7-9268-a6766478944b None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:26.533071 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:26.550097 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:26.575742 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38f6313-b8eb-4255-9535-32f9cc61503b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:26.576801 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f6313-b8eb-4255-9535-32f9cc61503b None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:26.577312 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f6313-b8eb-4255-9535-32f9cc61503b None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:26.578720 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f6313-b8eb-4255-9535-32f9cc61503b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:26.605154 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31436579-6365-4d68-9ccd-4611e6042d69 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:26.674674 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff270fc-8996-46f7-be59-bda8e6b8d1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:26.675668 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff270fc-8996-46f7-be59-bda8e6b8d1d6 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:26.676216 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff270fc-8996-46f7-be59-bda8e6b8d1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:26.676686 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff270fc-8996-46f7-be59-bda8e6b8d1d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:26.677820 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff270fc-8996-46f7-be59-bda8e6b8d1d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:26.678334 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff270fc-8996-46f7-be59-bda8e6b8d1d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:26.682019 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff270fc-8996-46f7-be59-bda8e6b8d1d6 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:26.716166 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 335/640] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:43:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:26.718511 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff270fc-8996-46f7-be59-bda8e6b8d1d6 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:26.750880 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38f6313-b8eb-4255-9535-32f9cc61503b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:26.754532 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38f6313-b8eb-4255-9535-32f9cc61503b None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:26.884345 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff270fc-8996-46f7-be59-bda8e6b8d1d6 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:26.922789 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 306/641] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Sep 18 00:43:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 660 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 00:43:26.922789 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38f6313-b8eb-4255-9535-32f9cc61503b None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:26.930309 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:26.943726 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9d3a2-90a7-4250-8c2e-7ee420421487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:26.944817 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9d3a2-90a7-4250-8c2e-7ee420421487 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:26.945240 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9d3a2-90a7-4250-8c2e-7ee420421487 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:26.945725 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9d3a2-90a7-4250-8c2e-7ee420421487 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:26.954364 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:26.962278 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae9d3a2-90a7-4250-8c2e-7ee420421487 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:26.964823 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae9d3a2-90a7-4250-8c2e-7ee420421487 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:26.984665 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-9ae9d3a2-90a7-4250-8c2e-7ee420421487 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:26.984665 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:26.984665 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:26.984665 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:26.984665 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:26.984665 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:26.984665 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:26.984665 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:26.984665 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:26.984665 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:26.984665 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:26.984665 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:26.984665 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:43:26.984665 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:43:26.984665 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:43:26.984665 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:43:26.986508 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:26.986508 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:26.986508 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:26.986508 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:26.986508 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:26.986508 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:26.986508 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:26.986508 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:26.986508 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:26.986508 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:26.986508 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:26.986508 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:26.986508 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:26.986508 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:26.986508 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:26.986508 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:26.986508 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:43:26.990465 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:43:26.990465 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:26.990465 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:26.990465 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 336/642] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:43:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:26.990465 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9d3a2-90a7-4250-8c2e-7ee420421487 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:27.065614 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38f6313-b8eb-4255-9535-32f9cc61503b None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:27.122037 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c70f9a-7891-4039-96f0-3441d50afba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:27.122690 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c70f9a-7891-4039-96f0-3441d50afba3 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:27.122971 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c70f9a-7891-4039-96f0-3441d50afba3 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:27.123258 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c70f9a-7891-4039-96f0-3441d50afba3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:27.132140 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c70f9a-7891-4039-96f0-3441d50afba3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:27.133605 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c70f9a-7891-4039-96f0-3441d50afba3 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:27.139730 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9d3a2-90a7-4250-8c2e-7ee420421487 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:27.146050 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-01c70f9a-7891-4039-96f0-3441d50afba3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 18 00:43:27.146050 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:27.146050 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:27.146050 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:27.146050 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:27.146050 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:27.146050 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:27.146050 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:27.146050 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:27.146050 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:27.146050 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:27.146050 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:27.146050 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 00:43:27.146050 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 00:43:27.146050 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 00:43:27.146050 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 00:43:27.153249 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:27.153249 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:27.153249 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 00:43:27.153249 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:43:27.153249 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 00:43:27.153249 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:43:27.153249 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:27.153249 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:27.153249 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:27.153249 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:27.153249 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:27.153249 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:27.153249 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:27.153249 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:27.153249 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:27.153249 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:27.153249 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:27.153249 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:27.154282 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:27.154282 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:27.154282 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 00:43:27.154282 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 00:43:27.154282 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 00:43:27.154282 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 00:43:27.154282 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 00:43:27.154282 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 00:43:27.154282 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 18 00:43:27.154282 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:27.154282 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 307/643] 10.222.0.15 () {56 vars in 1093 bytes} [Sun Sep 18 00:43:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:27.154282 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c70f9a-7891-4039-96f0-3441d50afba3 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:27.197441 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf97483-eead-4ed7-98bb-defa6c9c32ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:27.198349 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf97483-eead-4ed7-98bb-defa6c9c32ab None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:27.198898 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf97483-eead-4ed7-98bb-defa6c9c32ab None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:27.199264 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf97483-eead-4ed7-98bb-defa6c9c32ab None admin] PATH_INFO: `/v3/roles/service` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:27.214071 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf97483-eead-4ed7-98bb-defa6c9c32ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:43:27.220963 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-7bf97483-eead-4ed7-98bb-defa6c9c32ab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 18 00:43:27.220963 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:27.220963 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:27.220963 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:27.220963 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:27.220963 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:27.220963 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:27.220963 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:27.220963 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:27.220963 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:27.220963 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:27.220963 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:27.220963 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:43:27.220963 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:43:27.220963 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:43:27.220963 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:43:27.223323 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:43:27.223323 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:43:27.223323 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:43:27.223323 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:43:27.223323 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:27.223323 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:27.223323 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:27.223323 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:27.223323 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:27.223323 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:27.223323 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:27.223323 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:27.223323 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:27.223323 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:27.223323 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:27.223323 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:27.225224 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:27.225224 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:27.225224 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:27.225224 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:27.225224 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:43:27.225224 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:43:27.225224 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:43:27.225224 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:43:27.225224 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:43:27.225224 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:43:27.225224 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 18 00:43:27.225224 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:27.225224 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 337/644] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Sep 18 00:43:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:27.225224 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf97483-eead-4ed7-98bb-defa6c9c32ab None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:27.266113 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:27.285598 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c70f9a-7891-4039-96f0-3441d50afba3 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:27.287583 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:27.330984 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbbc4d1-b7f9-408f-8a13-79546d167533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:27.332148 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbbc4d1-b7f9-408f-8a13-79546d167533 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:27.332564 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbbc4d1-b7f9-408f-8a13-79546d167533 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:27.332981 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbbc4d1-b7f9-408f-8a13-79546d167533 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:27.347016 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbbc4d1-b7f9-408f-8a13-79546d167533 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:27.348758 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbbc4d1-b7f9-408f-8a13-79546d167533 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:27.366446 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf97483-eead-4ed7-98bb-defa6c9c32ab None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:27.367409 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-5dbbc4d1-b7f9-408f-8a13-79546d167533 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:27.367409 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:27.367409 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:27.367409 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:27.367409 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:27.367409 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:27.367409 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:27.367409 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:27.367409 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:27.367409 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:27.367409 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:27.367409 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:27.367409 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:43:27.367409 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:43:27.367409 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:43:27.367409 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:43:27.369257 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:27.369257 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:27.369257 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:27.369257 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:27.369257 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:27.369257 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:27.369257 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:27.369257 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:27.369257 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:27.369257 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:27.369257 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:27.369257 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:27.369257 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:27.369257 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:27.369257 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:27.369257 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:27.369257 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:43:27.371927 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:43:27.371927 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:27.371927 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:27.371927 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 308/645] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:43:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:27.371927 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbbc4d1-b7f9-408f-8a13-79546d167533 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:27.427044 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a8e80-949d-422f-951b-bca8ef4ca015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:27.427853 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a8e80-949d-422f-951b-bca8ef4ca015 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:27.429033 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a8e80-949d-422f-951b-bca8ef4ca015 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:27.429453 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a8e80-949d-422f-951b-bca8ef4ca015 None admin] PATH_INFO: `/v3/domains` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:27.430268 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34a8e80-949d-422f-951b-bca8ef4ca015 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:27.431113 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34a8e80-949d-422f-951b-bca8ef4ca015 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:27.433165 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34a8e80-949d-422f-951b-bca8ef4ca015 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:27.456064 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 338/646] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:43:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:27.456064 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a8e80-949d-422f-951b-bca8ef4ca015 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:27.521145 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbbc4d1-b7f9-408f-8a13-79546d167533 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:27.564466 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c6e7f-c805-43f0-93ac-3713c4f66bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:27.565246 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c6e7f-c805-43f0-93ac-3713c4f66bc8 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:27.565535 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c6e7f-c805-43f0-93ac-3713c4f66bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:27.565808 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c6e7f-c805-43f0-93ac-3713c4f66bc8 None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:27.566595 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6c6e7f-c805-43f0-93ac-3713c4f66bc8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:27.566923 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6c6e7f-c805-43f0-93ac-3713c4f66bc8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:27.568493 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6c6e7f-c805-43f0-93ac-3713c4f66bc8 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:27.577861 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:27.603018 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 309/647] 10.222.0.15 () {56 vars in 1133 bytes} [Sun Sep 18 00:43:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:27.603018 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c6e7f-c805-43f0-93ac-3713c4f66bc8 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:27.606312 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a8e80-949d-422f-951b-bca8ef4ca015 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:27.608310 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:27.653450 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347a2c68-8ce3-4b59-b55e-82d33b41400d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:27.654214 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a2c68-8ce3-4b59-b55e-82d33b41400d None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:27.654587 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a2c68-8ce3-4b59-b55e-82d33b41400d None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:27.654933 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a2c68-8ce3-4b59-b55e-82d33b41400d None admin] PATH_INFO: `/v3/roles` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:27.655667 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347a2c68-8ce3-4b59-b55e-82d33b41400d None admin] RBAC: Adding query filter params (name=service) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:27.656016 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347a2c68-8ce3-4b59-b55e-82d33b41400d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:27.657470 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347a2c68-8ce3-4b59-b55e-82d33b41400d None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:27.667060 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 339/648] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Sep 18 00:43:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:27.667963 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347a2c68-8ce3-4b59-b55e-82d33b41400d None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:27.746937 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c6e7f-c805-43f0-93ac-3713c4f66bc8 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:27.783044 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf20a1-9351-4b86-be3e-35c03d86fd09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:27.784227 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf20a1-9351-4b86-be3e-35c03d86fd09 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:27.784510 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf20a1-9351-4b86-be3e-35c03d86fd09 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:27.784784 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf20a1-9351-4b86-be3e-35c03d86fd09 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:27.785444 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdf20a1-9351-4b86-be3e-35c03d86fd09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:27.786245 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdf20a1-9351-4b86-be3e-35c03d86fd09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:27.787152 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdf20a1-9351-4b86-be3e-35c03d86fd09 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:27.807175 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 310/649] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:43:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:27.807175 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf20a1-9351-4b86-be3e-35c03d86fd09 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:27.824793 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347a2c68-8ce3-4b59-b55e-82d33b41400d None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:27.863314 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a118f-5a80-4bca-b77f-64f3b4082b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:27.863828 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a118f-5a80-4bca-b77f-64f3b4082b32 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:27.864144 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a118f-5a80-4bca-b77f-64f3b4082b32 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:27.864418 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a118f-5a80-4bca-b77f-64f3b4082b32 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:27.873709 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1a118f-5a80-4bca-b77f-64f3b4082b32 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:27.875269 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1a118f-5a80-4bca-b77f-64f3b4082b32 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:27.876169 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:27.888251 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-bc1a118f-5a80-4bca-b77f-64f3b4082b32 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 18 00:43:27.888251 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:27.888251 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:27.888251 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:27.888251 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:27.888251 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:27.888251 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:27.888251 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:27.888251 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:27.888251 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:27.888251 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:27.888251 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:27.888251 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 00:43:27.888251 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 00:43:27.888251 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 00:43:27.888251 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 00:43:27.889350 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:27.889350 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:27.889350 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 00:43:27.889350 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:43:27.889350 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 00:43:27.889350 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:43:27.889350 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:27.889350 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:27.889350 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:27.889350 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:27.889350 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:27.889350 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:27.889350 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:27.889350 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:27.889350 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:27.889350 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:27.889350 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:27.889350 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:27.890360 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:27.890360 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:27.890360 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 00:43:27.890360 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 00:43:27.890360 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 00:43:27.890360 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 00:43:27.890360 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 00:43:27.890360 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 00:43:27.890360 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 18 00:43:27.890360 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:27.894324 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 340/650] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Sep 18 00:43:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:27.895257 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a118f-5a80-4bca-b77f-64f3b4082b32 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:27.927503 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:27.937089 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf20a1-9351-4b86-be3e-35c03d86fd09 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:27.974979 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b54402-4f66-41da-8f84-fb9a7de7cd68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:27.975591 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b54402-4f66-41da-8f84-fb9a7de7cd68 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:27.975872 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b54402-4f66-41da-8f84-fb9a7de7cd68 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:27.976186 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b54402-4f66-41da-8f84-fb9a7de7cd68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:28.046861 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a118f-5a80-4bca-b77f-64f3b4082b32 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:28.071155 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b54402-4f66-41da-8f84-fb9a7de7cd68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:28.073961 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b54402-4f66-41da-8f84-fb9a7de7cd68 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:28.084493 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a71c52-b934-4aa8-aeb7-088d3be793d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:28.085152 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a71c52-b934-4aa8-aeb7-088d3be793d4 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:28.085436 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a71c52-b934-4aa8-aeb7-088d3be793d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:28.085738 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a71c52-b934-4aa8-aeb7-088d3be793d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:28.098747 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a71c52-b934-4aa8-aeb7-088d3be793d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:28.100302 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a71c52-b934-4aa8-aeb7-088d3be793d4 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:28.118582 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-86a71c52-b934-4aa8-aeb7-088d3be793d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:28.118582 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:28.118582 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:28.118582 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:28.118582 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:28.118582 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:28.118582 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:28.118582 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:28.118582 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:28.118582 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:28.118582 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:28.118582 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:28.118582 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:43:28.118582 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:43:28.118582 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:43:28.118582 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:43:28.120806 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:28.120806 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:28.120806 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:28.120806 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:28.120806 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:28.120806 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:28.120806 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:28.120806 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:28.120806 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:28.120806 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:28.120806 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:28.120806 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:28.120806 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:28.120806 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:28.120806 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:28.120806 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:28.120806 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:43:28.122497 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:43:28.122497 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:28.122497 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:28.122497 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 341/651] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:43:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:28.122497 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a71c52-b934-4aa8-aeb7-088d3be793d4 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:28.185086 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:28.245503 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 311/652] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Sep 18 00:43:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 00:43:28.247273 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b54402-4f66-41da-8f84-fb9a7de7cd68 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:28.266668 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:28.298028 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a71c52-b934-4aa8-aeb7-088d3be793d4 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:28.341682 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2391b860-5a6c-4d6d-99bd-f0b7c9df218d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:28.342330 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391b860-5a6c-4d6d-99bd-f0b7c9df218d None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:28.342612 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391b860-5a6c-4d6d-99bd-f0b7c9df218d None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:28.342890 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391b860-5a6c-4d6d-99bd-f0b7c9df218d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:28.355822 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2391b860-5a6c-4d6d-99bd-f0b7c9df218d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:28.357410 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2391b860-5a6c-4d6d-99bd-f0b7c9df218d None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:28.370644 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-2391b860-5a6c-4d6d-99bd-f0b7c9df218d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:43:28.370644 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:28.370644 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:28.370644 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:28.370644 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:28.370644 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:28.370644 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:28.370644 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:28.370644 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:28.370644 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:28.370644 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:28.370644 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:28.370644 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 00:43:28.370644 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 00:43:28.370644 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 00:43:28.372361 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 00:43:28.372361 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:28.372361 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:28.372361 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:28.372361 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:28.372361 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:28.372361 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:28.372361 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:28.372361 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:28.372361 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:28.372361 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:28.372361 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:28.372361 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:28.372361 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:28.372361 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:28.372361 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:28.372361 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:28.374119 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 00:43:28.374119 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 00:43:28.374119 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 00:43:28.374119 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 00:43:28.374119 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 00:43:28.374119 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 00:43:28.374119 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:43:28.374119 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:28.374119 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 342/653] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Sep 18 00:43:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:28.374119 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2391b860-5a6c-4d6d-99bd-f0b7c9df218d None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:28.454936 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b54402-4f66-41da-8f84-fb9a7de7cd68 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:28.498581 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1442e8-b615-4d05-b8a9-b40b423c42f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:28.499206 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1442e8-b615-4d05-b8a9-b40b423c42f9 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:28.499490 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1442e8-b615-4d05-b8a9-b40b423c42f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:28.499766 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1442e8-b615-4d05-b8a9-b40b423c42f9 None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:28.501110 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1442e8-b615-4d05-b8a9-b40b423c42f9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:28.501423 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1442e8-b615-4d05-b8a9-b40b423c42f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:28.503440 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1442e8-b615-4d05-b8a9-b40b423c42f9 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:28.522459 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 312/654] 10.222.0.15 () {56 vars in 1137 bytes} [Sun Sep 18 00:43:28 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:28.523318 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1442e8-b615-4d05-b8a9-b40b423c42f9 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:28.541764 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2391b860-5a6c-4d6d-99bd-f0b7c9df218d None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:28.549223 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:28.582443 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc209e4d-8a3f-41b9-9325-1012c41a1b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:28.583070 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc209e4d-8a3f-41b9-9325-1012c41a1b3c None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:28.583351 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc209e4d-8a3f-41b9-9325-1012c41a1b3c None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:28.583632 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc209e4d-8a3f-41b9-9325-1012c41a1b3c None admin] PATH_INFO: `/v3/domains` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:28.584326 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc209e4d-8a3f-41b9-9325-1012c41a1b3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:28.584628 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc209e4d-8a3f-41b9-9325-1012c41a1b3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:28.586026 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc209e4d-8a3f-41b9-9325-1012c41a1b3c None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:28.588816 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:28.601120 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 343/655] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:43:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:28.602001 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc209e4d-8a3f-41b9-9325-1012c41a1b3c None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:28.664383 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1442e8-b615-4d05-b8a9-b40b423c42f9 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:28.711364 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50940a7-9608-4ea2-931a-930117c6acae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:28.712400 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50940a7-9608-4ea2-931a-930117c6acae None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:28.712874 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50940a7-9608-4ea2-931a-930117c6acae None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:28.713326 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50940a7-9608-4ea2-931a-930117c6acae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:28.723928 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc209e4d-8a3f-41b9-9325-1012c41a1b3c None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:28.726882 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50940a7-9608-4ea2-931a-930117c6acae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:28.728567 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50940a7-9608-4ea2-931a-930117c6acae None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:28.754114 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-c50940a7-9608-4ea2-931a-930117c6acae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:28.754114 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:28.754114 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:28.754114 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:28.754114 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:28.754114 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:28.754114 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:28.754114 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:28.754114 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:28.754114 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:28.754114 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:28.754114 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:28.754114 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:43:28.754114 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:43:28.754114 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:43:28.754114 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:43:28.755601 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:28.755601 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:28.755601 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:28.755601 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:28.755601 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:28.755601 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:28.755601 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:28.755601 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:28.755601 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:28.755601 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:28.755601 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:28.755601 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:28.755601 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:28.755601 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:28.755601 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:28.755601 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:28.755601 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:43:28.756723 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:43:28.756723 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:28.756723 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:28.756723 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 313/656] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:43:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:28.758284 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d18758-794a-430a-a4f3-f53ff1d3b821 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:28.758774 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d18758-794a-430a-a4f3-f53ff1d3b821 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:28.759222 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d18758-794a-430a-a4f3-f53ff1d3b821 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:28.761702 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 314/657] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:43:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:43:28.762973 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d18758-794a-430a-a4f3-f53ff1d3b821 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:28.768731 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4010569-f654-4c04-b458-8df3622e5ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:28.769540 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4010569-f654-4c04-b458-8df3622e5ea4 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:28.770000 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4010569-f654-4c04-b458-8df3622e5ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:28.770459 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4010569-f654-4c04-b458-8df3622e5ea4 None admin] PATH_INFO: `/v3/projects` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:28.771243 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4010569-f654-4c04-b458-8df3622e5ea4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:28.771623 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4010569-f654-4c04-b458-8df3622e5ea4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:28.773181 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4010569-f654-4c04-b458-8df3622e5ea4 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:28.786542 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 344/658] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Sep 18 00:43:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:28.787414 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4010569-f654-4c04-b458-8df3622e5ea4 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:28.854916 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:28.868485 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:28.917926 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4010569-f654-4c04-b458-8df3622e5ea4 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:28.920503 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d18758-794a-430a-a4f3-f53ff1d3b821 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:28.960089 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf502076-3e12-40dd-a228-d9013074332d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:28.960921 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf502076-3e12-40dd-a228-d9013074332d None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:28.961292 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf502076-3e12-40dd-a228-d9013074332d None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:28.961716 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf502076-3e12-40dd-a228-d9013074332d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:28.965496 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b97a2-cb4b-409a-abf9-84fa16f50222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:28.966358 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b97a2-cb4b-409a-abf9-84fa16f50222 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:28.966711 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b97a2-cb4b-409a-abf9-84fa16f50222 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:28.967055 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b97a2-cb4b-409a-abf9-84fa16f50222 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:28.972803 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf502076-3e12-40dd-a228-d9013074332d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:28.974421 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf502076-3e12-40dd-a228-d9013074332d None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:28.989944 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-cf502076-3e12-40dd-a228-d9013074332d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 18 00:43:28.989944 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:28.989944 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:28.989944 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:28.989944 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:28.989944 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:28.989944 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:28.989944 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:28.989944 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:28.989944 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:28.989944 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:28.989944 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:28.989944 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 00:43:28.989944 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 00:43:28.989944 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 00:43:28.989944 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 00:43:28.992426 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:28.992426 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:28.992426 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 00:43:28.992426 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:43:28.992426 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 00:43:28.992426 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:43:28.992426 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:28.992426 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:28.992426 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:28.992426 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:28.992426 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:28.992426 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:28.992426 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:28.992426 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:28.992426 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:28.992426 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:28.992426 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:28.992426 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:28.994871 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:28.994871 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:28.994871 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 00:43:28.994871 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 00:43:28.994871 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 00:43:28.994871 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 00:43:28.994871 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 00:43:28.994871 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 00:43:28.994871 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 18 00:43:28.994871 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:28.994871 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 345/659] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Sep 18 00:43:28 2022] GET /identity/v3/users/neutron => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:28.994871 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf502076-3e12-40dd-a228-d9013074332d None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:29.063529 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755b97a2-cb4b-409a-abf9-84fa16f50222 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:29.065338 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755b97a2-cb4b-409a-abf9-84fa16f50222 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:29.136114 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:29.149692 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf502076-3e12-40dd-a228-d9013074332d None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:29.172100 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:29.179595 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 315/660] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Sep 18 00:43:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 00:43:29.180939 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b0c10-2867-4c70-aeb8-da518b63106d None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:29.181226 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b0c10-2867-4c70-aeb8-da518b63106d None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:29.181503 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b0c10-2867-4c70-aeb8-da518b63106d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:29.200025 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-b96b0c10-2867-4c70-aeb8-da518b63106d None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:43:29.201244 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-b96b0c10-2867-4c70-aeb8-da518b63106d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:43:29.209526 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1b6aa-dcb1-4065-b399-f98436a67c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:29.210595 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1b6aa-dcb1-4065-b399-f98436a67c41 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:29.211100 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1b6aa-dcb1-4065-b399-f98436a67c41 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:29.211602 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1b6aa-dcb1-4065-b399-f98436a67c41 None admin] PATH_INFO: `/v3/domains` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:29.212880 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e1b6aa-dcb1-4065-b399-f98436a67c41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:29.213409 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e1b6aa-dcb1-4065-b399-f98436a67c41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:29.216126 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e1b6aa-dcb1-4065-b399-f98436a67c41 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:29.238651 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 346/661] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:43:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:29.239956 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1b6aa-dcb1-4065-b399-f98436a67c41 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:29.278567 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 316/662] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:43:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 00:43:29.279702 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b0c10-2867-4c70-aeb8-da518b63106d None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:29.362026 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1b6aa-dcb1-4065-b399-f98436a67c41 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:29.410561 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81fba05-2fdd-4924-8c89-b907a7fee52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:29.411198 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81fba05-2fdd-4924-8c89-b907a7fee52a None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:29.411482 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81fba05-2fdd-4924-8c89-b907a7fee52a None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:29.411931 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81fba05-2fdd-4924-8c89-b907a7fee52a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:29.412706 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81fba05-2fdd-4924-8c89-b907a7fee52a None admin] RBAC: Adding query filter params (role.id=5e91422b372b43749fe857ffd7bba774, scope.project.id=52ebde8fa3f84ede9ef575f7c0780798, user.id=292700152741419f9f9a945f7587769a) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:29.413021 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81fba05-2fdd-4924-8c89-b907a7fee52a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:29.414546 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81fba05-2fdd-4924-8c89-b907a7fee52a None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:29.422709 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 347/663] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Sep 18 00:43:29 2022] GET /identity/v3/role_assignments?user.id=292700152741419f9f9a945f7587769a&scope.project.id=52ebde8fa3f84ede9ef575f7c0780798&role.id=5e91422b372b43749fe857ffd7bba774 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:29.423604 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81fba05-2fdd-4924-8c89-b907a7fee52a None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:29.450544 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:29.465564 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b0c10-2867-4c70-aeb8-da518b63106d None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:29.524094 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:29.544333 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e86ebbb-2f0e-46b3-9f58-2016085de793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:29.545661 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e86ebbb-2f0e-46b3-9f58-2016085de793 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:29.546328 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e86ebbb-2f0e-46b3-9f58-2016085de793 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:29.546989 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e86ebbb-2f0e-46b3-9f58-2016085de793 None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:29.548560 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e86ebbb-2f0e-46b3-9f58-2016085de793 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:29.549487 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e86ebbb-2f0e-46b3-9f58-2016085de793 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:29.552907 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e86ebbb-2f0e-46b3-9f58-2016085de793 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:29.589082 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 317/664] 10.222.0.15 () {56 vars in 1139 bytes} [Sun Sep 18 00:43:29 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:29.590933 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e86ebbb-2f0e-46b3-9f58-2016085de793 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:29.637343 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81fba05-2fdd-4924-8c89-b907a7fee52a None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:29.682020 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2798217-99bb-495f-bb96-3f4bbb4d638d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:29.682780 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2798217-99bb-495f-bb96-3f4bbb4d638d None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:29.683248 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2798217-99bb-495f-bb96-3f4bbb4d638d None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:29.683656 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2798217-99bb-495f-bb96-3f4bbb4d638d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:29.699393 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2798217-99bb-495f-bb96-3f4bbb4d638d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:29.701625 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2798217-99bb-495f-bb96-3f4bbb4d638d None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:29.722008 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-b2798217-99bb-495f-bb96-3f4bbb4d638d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:29.722008 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:29.722008 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:29.722008 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:29.722008 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:29.722008 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:29.722008 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:29.722008 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:29.722008 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:29.722008 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:29.722008 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:29.722008 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:29.722008 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:43:29.722008 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:43:29.722008 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:43:29.722008 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:43:29.723014 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:29.723014 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:29.723014 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:29.723014 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:29.723014 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:29.723014 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:29.723014 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:29.723014 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:29.723014 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:29.723014 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:29.723014 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:29.723014 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:29.723014 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:29.723014 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:29.723014 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:29.723014 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:29.723014 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:43:29.723937 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:43:29.723937 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:29.723937 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:29.723937 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 348/665] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:43:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:29.726107 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2798217-99bb-495f-bb96-3f4bbb4d638d None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:29.755058 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e86ebbb-2f0e-46b3-9f58-2016085de793 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:29.818656 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc34ef-10fc-4589-95e8-c2f2132527e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:29.819654 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc34ef-10fc-4589-95e8-c2f2132527e6 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:29.820153 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc34ef-10fc-4589-95e8-c2f2132527e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:29.820641 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc34ef-10fc-4589-95e8-c2f2132527e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:29.832291 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febc34ef-10fc-4589-95e8-c2f2132527e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:29.834201 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febc34ef-10fc-4589-95e8-c2f2132527e6 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:29.847007 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-febc34ef-10fc-4589-95e8-c2f2132527e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:43:29.847007 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:29.847007 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:29.847007 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:29.847007 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:29.847007 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:29.847007 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:29.847007 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:29.847007 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:29.847007 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:29.847007 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:29.847007 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:29.847007 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 00:43:29.847007 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 00:43:29.847007 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 00:43:29.848030 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 00:43:29.848030 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:29.848030 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:29.848030 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:29.848030 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:29.848030 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:29.848030 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:29.848030 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:29.848030 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:29.848030 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:29.848030 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:29.848030 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:29.848030 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:29.848030 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:29.848030 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:29.848030 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:29.848030 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:29.848928 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 00:43:29.848928 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 00:43:29.848928 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 00:43:29.848928 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 00:43:29.848928 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 00:43:29.848928 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 00:43:29.848928 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:43:29.848928 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:29.854756 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 318/666] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Sep 18 00:43:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:29.854756 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc34ef-10fc-4589-95e8-c2f2132527e6 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:29.870763 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:29.880862 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:29.886892 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2798217-99bb-495f-bb96-3f4bbb4d638d None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:29.947519 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72553e4e-c23c-4a80-b40c-eab0a0f992ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:29.948528 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72553e4e-c23c-4a80-b40c-eab0a0f992ef None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:29.949008 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72553e4e-c23c-4a80-b40c-eab0a0f992ef None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:29.949499 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72553e4e-c23c-4a80-b40c-eab0a0f992ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:29.989697 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc34ef-10fc-4589-95e8-c2f2132527e6 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:30.036693 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a83775-666a-4dc3-8bf0-4116b99fd763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:30.037754 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a83775-666a-4dc3-8bf0-4116b99fd763 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:30.038335 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a83775-666a-4dc3-8bf0-4116b99fd763 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:30.038739 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a83775-666a-4dc3-8bf0-4116b99fd763 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:30.048167 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72553e4e-c23c-4a80-b40c-eab0a0f992ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:30.049775 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72553e4e-c23c-4a80-b40c-eab0a0f992ef None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:30.057788 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a83775-666a-4dc3-8bf0-4116b99fd763 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:43:30.068561 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-90a83775-666a-4dc3-8bf0-4116b99fd763 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 18 00:43:30.068561 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:30.068561 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:30.068561 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:30.068561 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:30.068561 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:30.068561 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:30.068561 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:30.068561 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:30.068561 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:30.068561 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:30.068561 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:30.068561 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:43:30.068561 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:43:30.068561 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:43:30.068561 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:43:30.070302 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:43:30.070302 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:43:30.070302 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:43:30.070302 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:43:30.070302 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:30.070302 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:30.070302 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:30.070302 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:30.070302 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:30.070302 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:30.070302 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:30.070302 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:30.070302 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:30.070302 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:30.070302 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:30.070302 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:30.071874 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:30.071874 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:30.071874 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:30.071874 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:30.071874 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:43:30.071874 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:43:30.071874 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:43:30.071874 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:43:30.071874 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:43:30.071874 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:43:30.071874 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 18 00:43:30.071874 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:30.071874 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 319/667] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Sep 18 00:43:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:30.074899 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a83775-666a-4dc3-8bf0-4116b99fd763 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:30.177023 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:30.196232 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:30.216011 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 349/668] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Sep 18 00:43:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 00:43:30.216011 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72553e4e-c23c-4a80-b40c-eab0a0f992ef None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:30.251536 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a83775-666a-4dc3-8bf0-4116b99fd763 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:30.312542 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0414bc89-5b69-447a-bc59-8746176d92d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:30.313619 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414bc89-5b69-447a-bc59-8746176d92d5 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:30.313994 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414bc89-5b69-447a-bc59-8746176d92d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:30.314586 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414bc89-5b69-447a-bc59-8746176d92d5 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:30.316178 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0414bc89-5b69-447a-bc59-8746176d92d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:30.316782 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0414bc89-5b69-447a-bc59-8746176d92d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:30.319421 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0414bc89-5b69-447a-bc59-8746176d92d5 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:30.350351 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 320/669] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:43:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:30.351711 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72553e4e-c23c-4a80-b40c-eab0a0f992ef None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:30.352037 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0414bc89-5b69-447a-bc59-8746176d92d5 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:30.418280 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88326721-6513-4ff9-bf2d-dfaae3c83256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:30.418909 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88326721-6513-4ff9-bf2d-dfaae3c83256 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:30.419195 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88326721-6513-4ff9-bf2d-dfaae3c83256 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:30.419471 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88326721-6513-4ff9-bf2d-dfaae3c83256 None admin] PATH_INFO: `/v3/projects` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:30.420358 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88326721-6513-4ff9-bf2d-dfaae3c83256 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:30.420667 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88326721-6513-4ff9-bf2d-dfaae3c83256 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:30.422700 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88326721-6513-4ff9-bf2d-dfaae3c83256 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:30.445479 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 350/670] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Sep 18 00:43:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:30.445479 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88326721-6513-4ff9-bf2d-dfaae3c83256 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:30.505719 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0414bc89-5b69-447a-bc59-8746176d92d5 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:30.529819 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:30.549888 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:30.556983 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3924140-c0ec-45bb-b484-9d5c56c858c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:30.557830 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3924140-c0ec-45bb-b484-9d5c56c858c4 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:30.558115 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3924140-c0ec-45bb-b484-9d5c56c858c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:30.558397 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3924140-c0ec-45bb-b484-9d5c56c858c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:30.559151 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3924140-c0ec-45bb-b484-9d5c56c858c4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:30.559577 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3924140-c0ec-45bb-b484-9d5c56c858c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:30.561157 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3924140-c0ec-45bb-b484-9d5c56c858c4 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:30.571340 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 321/671] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Sep 18 00:43:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:30.572508 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3924140-c0ec-45bb-b484-9d5c56c858c4 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:30.591920 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88326721-6513-4ff9-bf2d-dfaae3c83256 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:30.633305 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2393d5-2c45-4deb-8db6-975e6b3b0ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:30.633944 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2393d5-2c45-4deb-8db6-975e6b3b0ed2 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:30.634282 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2393d5-2c45-4deb-8db6-975e6b3b0ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:30.634556 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2393d5-2c45-4deb-8db6-975e6b3b0ed2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:30.648857 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2393d5-2c45-4deb-8db6-975e6b3b0ed2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:30.650453 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2393d5-2c45-4deb-8db6-975e6b3b0ed2 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:30.667559 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-8c2393d5-2c45-4deb-8db6-975e6b3b0ed2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:30.667559 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:30.667559 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:30.667559 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:30.667559 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:30.667559 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:30.667559 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:30.667559 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:30.667559 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:30.667559 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:30.667559 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:30.667559 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:30.667559 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:43:30.667559 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:43:30.667559 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:43:30.667559 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:43:30.668736 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:30.668736 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:30.668736 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:30.668736 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:30.668736 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:30.668736 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:30.668736 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:30.668736 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:30.668736 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:30.668736 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:30.668736 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:30.668736 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:30.668736 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:30.668736 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:30.668736 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:30.668736 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:30.668736 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:43:30.670015 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:43:30.670015 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:30.670015 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:30.670015 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 351/672] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:43:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:30.670015 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2393d5-2c45-4deb-8db6-975e6b3b0ed2 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:30.697320 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3924140-c0ec-45bb-b484-9d5c56c858c4 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:30.734539 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c204087-085c-424d-9b29-75fa052bf0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:30.735081 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c204087-085c-424d-9b29-75fa052bf0ac None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:30.735357 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c204087-085c-424d-9b29-75fa052bf0ac None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:30.735636 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c204087-085c-424d-9b29-75fa052bf0ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:30.744001 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c204087-085c-424d-9b29-75fa052bf0ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:30.745490 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c204087-085c-424d-9b29-75fa052bf0ac None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:30.758282 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-8c204087-085c-424d-9b29-75fa052bf0ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:43:30.758282 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:30.758282 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:30.758282 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:30.758282 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:30.758282 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:30.758282 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:30.758282 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:30.758282 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:30.758282 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:30.758282 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:30.758282 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:30.758282 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 00:43:30.758282 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 00:43:30.758282 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 00:43:30.759202 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 00:43:30.759202 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:30.759202 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:30.759202 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:30.759202 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:30.759202 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:30.759202 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:30.759202 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:30.759202 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:30.759202 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:30.759202 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:30.759202 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:30.759202 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:30.759202 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:30.759202 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:30.759202 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:30.759202 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:30.760483 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 00:43:30.760483 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 00:43:30.760483 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 00:43:30.760483 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 00:43:30.760483 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 00:43:30.760483 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 00:43:30.760483 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:43:30.760483 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:30.760483 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 322/673] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Sep 18 00:43:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:30.760483 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c204087-085c-424d-9b29-75fa052bf0ac None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:30.829788 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:30.857922 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2393d5-2c45-4deb-8db6-975e6b3b0ed2 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:30.862276 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:30.898512 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c204087-085c-424d-9b29-75fa052bf0ac None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:30.904068 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab5c2a4-7f38-4a71-9f48-14885ecb2bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:30.905130 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5c2a4-7f38-4a71-9f48-14885ecb2bc7 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:30.905631 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5c2a4-7f38-4a71-9f48-14885ecb2bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:30.906113 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5c2a4-7f38-4a71-9f48-14885ecb2bc7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:30.907519 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab5c2a4-7f38-4a71-9f48-14885ecb2bc7 None admin] RBAC: Adding query filter params (role.id=5e91422b372b43749fe857ffd7bba774, scope.project.id=52ebde8fa3f84ede9ef575f7c0780798, user.id=264c183fff8a49478eea4aceea73273e) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:30.908107 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab5c2a4-7f38-4a71-9f48-14885ecb2bc7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:30.911536 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab5c2a4-7f38-4a71-9f48-14885ecb2bc7 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:30.921054 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 352/674] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Sep 18 00:43:30 2022] GET /identity/v3/role_assignments?user.id=264c183fff8a49478eea4aceea73273e&scope.project.id=52ebde8fa3f84ede9ef575f7c0780798&role.id=5e91422b372b43749fe857ffd7bba774 => generated 608 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:30.921054 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab5c2a4-7f38-4a71-9f48-14885ecb2bc7 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:30.958783 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970fb98b-0f47-47aa-99c2-906eee792539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:30.959854 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970fb98b-0f47-47aa-99c2-906eee792539 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:30.960380 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970fb98b-0f47-47aa-99c2-906eee792539 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:30.960876 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970fb98b-0f47-47aa-99c2-906eee792539 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:30.975317 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970fb98b-0f47-47aa-99c2-906eee792539 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:30.977308 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970fb98b-0f47-47aa-99c2-906eee792539 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:30.993978 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-970fb98b-0f47-47aa-99c2-906eee792539 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:30.993978 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:30.993978 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:30.993978 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:30.993978 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:30.993978 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:30.993978 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:30.993978 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:30.993978 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:30.993978 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:30.993978 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:30.993978 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:30.993978 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:43:30.993978 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:43:30.993978 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:43:30.993978 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:43:30.995378 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:30.995378 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:30.995378 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:30.995378 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:30.995378 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:30.995378 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:30.995378 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:30.995378 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:30.995378 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:30.995378 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:30.995378 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:30.995378 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:30.995378 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:30.995378 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:30.995378 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:30.995378 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:30.995378 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:43:30.996335 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:43:30.996335 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:30.996335 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:30.998625 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 323/675] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:43:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:30.999813 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970fb98b-0f47-47aa-99c2-906eee792539 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:31.080551 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab5c2a4-7f38-4a71-9f48-14885ecb2bc7 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:31.132016 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f6ad3-a028-4400-a3b3-81498c649511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:31.133108 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f6ad3-a028-4400-a3b3-81498c649511 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:31.133623 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f6ad3-a028-4400-a3b3-81498c649511 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:31.134202 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f6ad3-a028-4400-a3b3-81498c649511 None admin] PATH_INFO: `/v3/domains` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:31.135185 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499f6ad3-a028-4400-a3b3-81498c649511 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:31.135709 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499f6ad3-a028-4400-a3b3-81498c649511 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:31.137517 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499f6ad3-a028-4400-a3b3-81498c649511 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:31.142150 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970fb98b-0f47-47aa-99c2-906eee792539 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:31.155981 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 353/676] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:43:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:31.157075 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f6ad3-a028-4400-a3b3-81498c649511 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:31.159058 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:31.199724 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505a9eb-9e70-431a-9dc6-9810c4eec06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:31.200420 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505a9eb-9e70-431a-9dc6-9810c4eec06f None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:31.200713 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505a9eb-9e70-431a-9dc6-9810c4eec06f None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:31.200985 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505a9eb-9e70-431a-9dc6-9810c4eec06f None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:31.201680 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8505a9eb-9e70-431a-9dc6-9810c4eec06f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:31.201823 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:31.201989 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8505a9eb-9e70-431a-9dc6-9810c4eec06f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:31.203516 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8505a9eb-9e70-431a-9dc6-9810c4eec06f None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:31.218001 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 324/677] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Sep 18 00:43:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:31.219449 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505a9eb-9e70-431a-9dc6-9810c4eec06f None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:31.331839 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f6ad3-a028-4400-a3b3-81498c649511 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:31.368412 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505a9eb-9e70-431a-9dc6-9810c4eec06f None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:31.374347 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee896af-43e5-43ed-a2e1-92dc034fbfda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:31.374982 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee896af-43e5-43ed-a2e1-92dc034fbfda None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:31.375360 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee896af-43e5-43ed-a2e1-92dc034fbfda None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:31.375744 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee896af-43e5-43ed-a2e1-92dc034fbfda None admin] PATH_INFO: `/v3/domains` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:31.378490 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee896af-43e5-43ed-a2e1-92dc034fbfda None admin] RBAC: Adding query filter params (name=Default) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:31.378647 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee896af-43e5-43ed-a2e1-92dc034fbfda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:31.380103 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee896af-43e5-43ed-a2e1-92dc034fbfda None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:31.397573 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 354/678] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:43:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:31.398550 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee896af-43e5-43ed-a2e1-92dc034fbfda None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:31.418108 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab2aeae-07b9-4d1c-86fd-ec8337dd0445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:31.418883 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2aeae-07b9-4d1c-86fd-ec8337dd0445 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:31.419270 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2aeae-07b9-4d1c-86fd-ec8337dd0445 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:31.419544 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2aeae-07b9-4d1c-86fd-ec8337dd0445 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:31.429033 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab2aeae-07b9-4d1c-86fd-ec8337dd0445 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:31.430948 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab2aeae-07b9-4d1c-86fd-ec8337dd0445 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:31.443354 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-1ab2aeae-07b9-4d1c-86fd-ec8337dd0445 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:43:31.443354 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:31.443354 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:31.443354 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:31.443354 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:31.443354 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:31.443354 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:31.443354 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:31.443354 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:31.443354 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:31.443354 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:31.443354 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:31.443354 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 00:43:31.443354 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 00:43:31.443354 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 00:43:31.444334 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 00:43:31.444334 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:31.444334 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:31.444334 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:31.444334 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:31.444334 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:31.444334 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:31.444334 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:31.444334 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:31.444334 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:31.444334 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:31.444334 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:31.444334 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:31.444334 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:31.444334 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:31.444334 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:31.444334 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:31.445208 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 00:43:31.445208 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 00:43:31.445208 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 00:43:31.445208 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 00:43:31.445208 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 00:43:31.445208 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 00:43:31.445208 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:43:31.445208 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:31.445208 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 325/679] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Sep 18 00:43:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:31.445700 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab2aeae-07b9-4d1c-86fd-ec8337dd0445 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:31.476289 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:31.540944 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:31.559321 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee896af-43e5-43ed-a2e1-92dc034fbfda None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:31.604117 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab2aeae-07b9-4d1c-86fd-ec8337dd0445 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:31.621268 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b52074-722c-400b-a5f7-30f31972cffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:31.621970 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b52074-722c-400b-a5f7-30f31972cffa None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:31.622253 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b52074-722c-400b-a5f7-30f31972cffa None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:31.622526 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b52074-722c-400b-a5f7-30f31972cffa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:31.623272 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b52074-722c-400b-a5f7-30f31972cffa None admin] RBAC: Adding query filter params (role.id=5e91422b372b43749fe857ffd7bba774, scope.project.id=52ebde8fa3f84ede9ef575f7c0780798, user.id=6dbec16b81004ad3b4563ccc83d85c69) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:31.623580 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b52074-722c-400b-a5f7-30f31972cffa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:31.626087 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b52074-722c-400b-a5f7-30f31972cffa None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:31.635176 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 355/680] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Sep 18 00:43:31 2022] GET /identity/v3/role_assignments?user.id=6dbec16b81004ad3b4563ccc83d85c69&scope.project.id=52ebde8fa3f84ede9ef575f7c0780798&role.id=5e91422b372b43749fe857ffd7bba774 => generated 608 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:31.636961 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b52074-722c-400b-a5f7-30f31972cffa None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:31.657152 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f171fc86-5be7-4d44-a448-a351636a24cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:31.659109 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171fc86-5be7-4d44-a448-a351636a24cc None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:31.659815 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171fc86-5be7-4d44-a448-a351636a24cc None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:31.660572 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171fc86-5be7-4d44-a448-a351636a24cc None admin] PATH_INFO: `/v3/users/swift` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:31.671938 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f171fc86-5be7-4d44-a448-a351636a24cc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:31.674705 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f171fc86-5be7-4d44-a448-a351636a24cc None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:31.693121 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-f171fc86-5be7-4d44-a448-a351636a24cc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 18 00:43:31.693121 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:31.693121 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:31.693121 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:31.693121 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:31.693121 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:31.693121 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:31.693121 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:31.693121 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:31.693121 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:31.693121 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:31.693121 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:31.693121 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 00:43:31.693121 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 00:43:31.693121 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 00:43:31.693121 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 00:43:31.694737 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:31.694737 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:31.694737 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 00:43:31.694737 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:43:31.694737 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 00:43:31.694737 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:43:31.694737 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:31.694737 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:31.694737 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:31.694737 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:31.694737 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:31.694737 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:31.694737 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:31.694737 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:31.694737 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:31.694737 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:31.694737 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:31.694737 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:31.695959 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:31.695959 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:31.695959 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 00:43:31.695959 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 00:43:31.695959 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 00:43:31.695959 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 00:43:31.695959 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 00:43:31.695959 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 00:43:31.695959 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 18 00:43:31.695959 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:31.699168 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 326/681] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Sep 18 00:43:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:31.707019 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f171fc86-5be7-4d44-a448-a351636a24cc None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:31.866781 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b52074-722c-400b-a5f7-30f31972cffa None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:31.925695 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7b4e63-2a59-4f9e-961f-01c8f1e51b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:31.925695 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b4e63-2a59-4f9e-961f-01c8f1e51b0d None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:31.926788 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b4e63-2a59-4f9e-961f-01c8f1e51b0d None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:31.926788 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b4e63-2a59-4f9e-961f-01c8f1e51b0d None admin] PATH_INFO: `/v3/projects` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:31.927080 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7b4e63-2a59-4f9e-961f-01c8f1e51b0d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:31.927213 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7b4e63-2a59-4f9e-961f-01c8f1e51b0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:31.928739 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7b4e63-2a59-4f9e-961f-01c8f1e51b0d None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:31.946593 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 356/682] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Sep 18 00:43:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:31.957467 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7b4e63-2a59-4f9e-961f-01c8f1e51b0d None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:31.962312 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:31.980978 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:31.992274 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f171fc86-5be7-4d44-a448-a351636a24cc None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:32.055762 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6f09a-4243-4dc8-aa01-c6b06fd855f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:32.058834 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6f09a-4243-4dc8-aa01-c6b06fd855f8 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:32.059706 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6f09a-4243-4dc8-aa01-c6b06fd855f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:32.060457 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6f09a-4243-4dc8-aa01-c6b06fd855f8 None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:32.062444 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc6f09a-4243-4dc8-aa01-c6b06fd855f8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:32.063872 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc6f09a-4243-4dc8-aa01-c6b06fd855f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:32.067603 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc6f09a-4243-4dc8-aa01-c6b06fd855f8 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:32.106615 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 327/683] 10.222.0.15 () {56 vars in 1135 bytes} [Sun Sep 18 00:43:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:32.113927 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66f014-b501-44a3-bf28-4946a413cc68 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:32.114313 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66f014-b501-44a3-bf28-4946a413cc68 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:32.114674 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66f014-b501-44a3-bf28-4946a413cc68 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:32.116485 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 328/684] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:43:32 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:43:32.124114 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f66f014-b501-44a3-bf28-4946a413cc68 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:32.154960 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7b4e63-2a59-4f9e-961f-01c8f1e51b0d None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:32.207456 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a480711-b813-4df6-bb63-258d45bca763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:32.208446 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a480711-b813-4df6-bb63-258d45bca763 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:32.209085 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a480711-b813-4df6-bb63-258d45bca763 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:32.209626 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a480711-b813-4df6-bb63-258d45bca763 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:32.210594 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a480711-b813-4df6-bb63-258d45bca763 None admin] RBAC: Adding query filter params (role.id=5e91422b372b43749fe857ffd7bba774, scope.project.id=52ebde8fa3f84ede9ef575f7c0780798, user.id=9e46cfbc3b604788a833a81befaaab06) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:32.211119 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a480711-b813-4df6-bb63-258d45bca763 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:32.213009 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a480711-b813-4df6-bb63-258d45bca763 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:32.222123 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 357/685] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Sep 18 00:43:31 2022] GET /identity/v3/role_assignments?user.id=9e46cfbc3b604788a833a81befaaab06&scope.project.id=52ebde8fa3f84ede9ef575f7c0780798&role.id=5e91422b372b43749fe857ffd7bba774 => generated 608 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:32.223470 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f085236e-87a3-402f-9548-90fada5660e8 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:32.223755 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f085236e-87a3-402f-9548-90fada5660e8 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:32.224080 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f085236e-87a3-402f-9548-90fada5660e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:32.245875 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-f085236e-87a3-402f-9548-90fada5660e8 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:43:32.247132 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-f085236e-87a3-402f-9548-90fada5660e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:43:32.333412 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 358/686] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:43:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 00:43:32.334748 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f66f014-b501-44a3-bf28-4946a413cc68 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:32.408222 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3233c4-b2a5-4c5a-b17b-ff9908b3ab54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:32.409825 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3233c4-b2a5-4c5a-b17b-ff9908b3ab54 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:32.410306 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3233c4-b2a5-4c5a-b17b-ff9908b3ab54 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:32.410706 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3233c4-b2a5-4c5a-b17b-ff9908b3ab54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:32.429936 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:32.512632 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3233c4-b2a5-4c5a-b17b-ff9908b3ab54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:32.515222 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3233c4-b2a5-4c5a-b17b-ff9908b3ab54 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:32.658129 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f085236e-87a3-402f-9548-90fada5660e8 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:32.668561 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:32.726688 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 329/687] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Sep 18 00:43:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 18 00:43:32.736270 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3233c4-b2a5-4c5a-b17b-ff9908b3ab54 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:32.813199 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f085236e-87a3-402f-9548-90fada5660e8 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:32.844401 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:32.865605 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2393286-eea5-4f6b-8f20-23faa65f73a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:32.867129 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2393286-eea5-4f6b-8f20-23faa65f73a2 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:32.867878 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2393286-eea5-4f6b-8f20-23faa65f73a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:32.868640 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2393286-eea5-4f6b-8f20-23faa65f73a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:32.905434 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2393286-eea5-4f6b-8f20-23faa65f73a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:32.907465 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2393286-eea5-4f6b-8f20-23faa65f73a2 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:32.946543 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-e2393286-eea5-4f6b-8f20-23faa65f73a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:32.946543 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:32.946543 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:32.946543 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:32.946543 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:32.946543 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:32.946543 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:32.946543 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:32.946543 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:32.946543 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:32.946543 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:32.946543 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:32.946543 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:43:32.946543 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:43:32.946543 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:43:32.946543 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:43:32.949048 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:32.949048 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:32.949048 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:32.949048 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:32.949048 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:32.949048 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:32.949048 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:32.949048 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:32.949048 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:32.949048 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:32.949048 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:32.949048 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:32.949048 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:32.949048 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:32.949048 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:32.949048 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:32.949048 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:43:32.950802 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:43:32.950802 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:32.950802 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:32.956461 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 359/688] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:43:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 00:43:32.964770 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3233c4-b2a5-4c5a-b17b-ff9908b3ab54 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:32.965881 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2393286-eea5-4f6b-8f20-23faa65f73a2 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:33.063497 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f08edf-1c69-4369-9232-7f4996e53df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:33.064321 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f08edf-1c69-4369-9232-7f4996e53df6 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:33.064460 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f08edf-1c69-4369-9232-7f4996e53df6 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:33.068022 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f08edf-1c69-4369-9232-7f4996e53df6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:33.090678 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:33.093155 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f08edf-1c69-4369-9232-7f4996e53df6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:33.094674 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f08edf-1c69-4369-9232-7f4996e53df6 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:33.136486 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-99f08edf-1c69-4369-9232-7f4996e53df6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:33.136486 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:33.136486 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:33.136486 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:33.136486 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:33.136486 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:33.136486 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:33.136486 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:33.136486 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:33.136486 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:33.136486 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:33.136486 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:33.136486 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:43:33.136486 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:43:33.136486 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:43:33.136486 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:43:33.138308 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:33.138308 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:33.138308 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:33.138308 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:33.138308 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:33.138308 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:33.138308 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:33.138308 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:33.138308 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:33.138308 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:33.138308 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:33.138308 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:33.138308 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:33.138308 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:33.138308 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:33.138308 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:33.138308 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:43:33.140048 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:43:33.140048 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:33.140048 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:33.140048 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 330/689] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:43:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 403 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:33.148704 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2393286-eea5-4f6b-8f20-23faa65f73a2 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:33.149035 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f08edf-1c69-4369-9232-7f4996e53df6 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:33.225580 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c14d26-2df5-40f5-87d4-72a297100f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:33.226118 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c14d26-2df5-40f5-87d4-72a297100f58 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:33.226397 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c14d26-2df5-40f5-87d4-72a297100f58 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:33.226672 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c14d26-2df5-40f5-87d4-72a297100f58 None admin] PATH_INFO: `/v3/domains` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:33.227329 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c14d26-2df5-40f5-87d4-72a297100f58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:33.227631 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c14d26-2df5-40f5-87d4-72a297100f58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:33.229205 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c14d26-2df5-40f5-87d4-72a297100f58 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:33.264038 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 360/690] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:43:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:33.274893 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c14d26-2df5-40f5-87d4-72a297100f58 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:33.386928 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:33.411959 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f08edf-1c69-4369-9232-7f4996e53df6 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:33.517077 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b33192-f435-4eab-be11-d615cd07cdd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:33.519195 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b33192-f435-4eab-be11-d615cd07cdd4 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:33.520014 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b33192-f435-4eab-be11-d615cd07cdd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:33.520731 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b33192-f435-4eab-be11-d615cd07cdd4 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:33.521666 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b33192-f435-4eab-be11-d615cd07cdd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:33.522465 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b33192-f435-4eab-be11-d615cd07cdd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:33.525252 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b33192-f435-4eab-be11-d615cd07cdd4 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:33.544705 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 331/691] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:43:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:43:33.551090 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b33192-f435-4eab-be11-d615cd07cdd4 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:33.569887 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c14d26-2df5-40f5-87d4-72a297100f58 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:33.620302 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:33.661128 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70428e7f-983d-47e6-8c07-06c8038fabd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:33.662222 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70428e7f-983d-47e6-8c07-06c8038fabd6 None admin] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:33.662715 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70428e7f-983d-47e6-8c07-06c8038fabd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:33.663202 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70428e7f-983d-47e6-8c07-06c8038fabd6 None admin] PATH_INFO: `/v3/users` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:33.664428 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70428e7f-983d-47e6-8c07-06c8038fabd6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:33.667498 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70428e7f-983d-47e6-8c07-06c8038fabd6 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:33.730497 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 361/692] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Sep 18 00:43:33 2022] POST /identity/v3/users => generated 254 bytes in 451 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 00:43:33.785722 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b33192-f435-4eab-be11-d615cd07cdd4 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:33.854212 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be939260-a21d-49f2-aa19-a5dbe701ff20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:33.857981 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be939260-a21d-49f2-aa19-a5dbe701ff20 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:33.858546 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be939260-a21d-49f2-aa19-a5dbe701ff20 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:33.859034 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be939260-a21d-49f2-aa19-a5dbe701ff20 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:33.877709 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be939260-a21d-49f2-aa19-a5dbe701ff20 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:33.880507 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be939260-a21d-49f2-aa19-a5dbe701ff20 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:33.903585 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-be939260-a21d-49f2-aa19-a5dbe701ff20 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:43:33.903585 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:33.903585 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:33.903585 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:33.903585 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:33.903585 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:33.903585 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:33.903585 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:33.903585 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:33.903585 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:33.903585 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:33.903585 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:33.903585 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 00:43:33.903585 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 00:43:33.903585 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 00:43:33.904642 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 00:43:33.904642 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:33.904642 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:33.904642 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:33.904642 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:33.904642 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:33.904642 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:33.904642 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:33.904642 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:33.904642 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:33.904642 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:33.904642 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:33.904642 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:33.904642 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:33.904642 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:33.904642 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:33.904642 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:33.905592 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 00:43:33.905592 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 00:43:33.905592 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 00:43:33.905592 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 00:43:33.905592 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 00:43:33.905592 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 00:43:33.905592 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:43:33.905592 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:33.906489 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 332/693] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Sep 18 00:43:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:33.916673 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70428e7f-983d-47e6-8c07-06c8038fabd6 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:34.109367 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70428e7f-983d-47e6-8c07-06c8038fabd6 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:34.152409 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb358d-7b83-48bd-8dc8-fa013b666056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:34.153449 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb358d-7b83-48bd-8dc8-fa013b666056 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:34.153968 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb358d-7b83-48bd-8dc8-fa013b666056 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:34.154470 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb358d-7b83-48bd-8dc8-fa013b666056 None admin] PATH_INFO: `/v3/projects` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:34.155399 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eb358d-7b83-48bd-8dc8-fa013b666056 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:34.155952 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eb358d-7b83-48bd-8dc8-fa013b666056 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:34.157641 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eb358d-7b83-48bd-8dc8-fa013b666056 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:34.170899 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b147b-a1da-406c-a4c0-ff83f5b18f84 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:34.171452 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b147b-a1da-406c-a4c0-ff83f5b18f84 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:34.171452 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b147b-a1da-406c-a4c0-ff83f5b18f84 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:34.173179 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 333/694] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:43:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:43:34.173945 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 362/695] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Sep 18 00:43:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:43:34.179223 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc5b49-82f4-421e-aa09-ca1252a88874 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:34.179223 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc5b49-82f4-421e-aa09-ca1252a88874 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:34.179223 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc5b49-82f4-421e-aa09-ca1252a88874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:34.185069 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb358d-7b83-48bd-8dc8-fa013b666056 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:34.202244 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-c6dc5b49-82f4-421e-aa09-ca1252a88874 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:43:34.203483 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-c6dc5b49-82f4-421e-aa09-ca1252a88874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:43:34.220648 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:34.234432 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:34.334516 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 334/696] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:43:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 00:43:34.343675 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb358d-7b83-48bd-8dc8-fa013b666056 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:34.388154 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606558ad-a449-4f4a-ada1-4cda3da7a696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:34.389145 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606558ad-a449-4f4a-ada1-4cda3da7a696 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:34.389648 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606558ad-a449-4f4a-ada1-4cda3da7a696 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:34.390122 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606558ad-a449-4f4a-ada1-4cda3da7a696 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:34.391063 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606558ad-a449-4f4a-ada1-4cda3da7a696 None admin] RBAC: Adding query filter params (role.id=5e91422b372b43749fe857ffd7bba774, scope.project.id=52ebde8fa3f84ede9ef575f7c0780798, user.id=d0f16f1f2cb8475d9d5c752f56c4b74d) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:34.391572 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606558ad-a449-4f4a-ada1-4cda3da7a696 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:34.393809 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606558ad-a449-4f4a-ada1-4cda3da7a696 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:34.401122 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 363/697] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Sep 18 00:43:34 2022] GET /identity/v3/role_assignments?user.id=d0f16f1f2cb8475d9d5c752f56c4b74d&scope.project.id=52ebde8fa3f84ede9ef575f7c0780798&role.id=5e91422b372b43749fe857ffd7bba774 => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:43:34.770663 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc5b49-82f4-421e-aa09-ca1252a88874 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:34.926471 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc5b49-82f4-421e-aa09-ca1252a88874 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:34.997290 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07abb4f-4502-422e-b786-c1c63d32f978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:34.997942 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa8ff7-1063-434b-a8fe-caf75f3458c5 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:34.998236 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa8ff7-1063-434b-a8fe-caf75f3458c5 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:34.998403 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07abb4f-4502-422e-b786-c1c63d32f978 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:34.998553 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa8ff7-1063-434b-a8fe-caf75f3458c5 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:34.998842 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07abb4f-4502-422e-b786-c1c63d32f978 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:34.999261 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07abb4f-4502-422e-b786-c1c63d32f978 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:35.003835 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 364/698] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:43:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 18 00:43:35.006855 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d65ea-84c7-42ea-9d57-bcf662a82280 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:35.007189 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d65ea-84c7-42ea-9d57-bcf662a82280 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:35.007437 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d65ea-84c7-42ea-9d57-bcf662a82280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:35.022656 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07abb4f-4502-422e-b786-c1c63d32f978 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:43:35.028452 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-ac8d65ea-84c7-42ea-9d57-bcf662a82280 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:43:35.029689 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-ac8d65ea-84c7-42ea-9d57-bcf662a82280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:43:35.032171 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-f07abb4f-4502-422e-b786-c1c63d32f978 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 00:43:35.032171 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:35.032171 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:35.032171 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:35.032171 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:35.032171 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:35.032171 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:35.032171 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:35.032171 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:35.032171 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:35.032171 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:35.032171 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:35.032171 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:43:35.032171 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:43:35.032171 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:43:35.032171 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:43:35.034007 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:43:35.034007 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:43:35.034007 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:43:35.034007 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:43:35.034007 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:35.034007 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:35.034007 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:35.034007 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:35.034007 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:35.034007 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:35.034007 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:35.034007 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:35.034007 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:35.034007 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:35.034007 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:35.034007 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:35.035136 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:35.035136 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:35.035136 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:35.035136 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:35.035136 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:43:35.035136 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:43:35.035136 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:43:35.035136 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:43:35.035136 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:43:35.035136 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:43:35.035136 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 00:43:35.035136 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:35.035136 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 335/699] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Sep 18 00:43:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:35.045713 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07abb4f-4502-422e-b786-c1c63d32f978 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:35.064917 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:35.141567 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 365/700] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:43:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 18 00:43:35.228443 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07abb4f-4502-422e-b786-c1c63d32f978 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:35.280064 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfde4f93-07e3-44ff-bd42-802c6b451d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:35.280620 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde4f93-07e3-44ff-bd42-802c6b451d45 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:35.280907 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde4f93-07e3-44ff-bd42-802c6b451d45 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:35.281184 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde4f93-07e3-44ff-bd42-802c6b451d45 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:35.281866 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfde4f93-07e3-44ff-bd42-802c6b451d45 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:35.282174 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfde4f93-07e3-44ff-bd42-802c6b451d45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:35.284138 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfde4f93-07e3-44ff-bd42-802c6b451d45 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:35.294167 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 336/701] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Sep 18 00:43:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:43:35.301221 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d65ea-84c7-42ea-9d57-bcf662a82280 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:35.339685 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:35.433176 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d65ea-84c7-42ea-9d57-bcf662a82280 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:35.493218 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1312072-6cea-4af3-a859-c8f0762daa79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:35.493878 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1312072-6cea-4af3-a859-c8f0762daa79 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:35.494161 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1312072-6cea-4af3-a859-c8f0762daa79 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:35.494437 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1312072-6cea-4af3-a859-c8f0762daa79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:35.514956 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1312072-6cea-4af3-a859-c8f0762daa79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:35.526030 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1312072-6cea-4af3-a859-c8f0762daa79 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:35.555718 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-a1312072-6cea-4af3-a859-c8f0762daa79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:35.555718 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:35.555718 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:35.555718 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:35.555718 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:35.555718 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:35.555718 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:35.555718 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:35.555718 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:35.555718 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:35.555718 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:35.555718 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:35.555718 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:43:35.555718 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:43:35.555718 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:43:35.555718 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:43:35.556741 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:35.556741 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:35.556741 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:35.556741 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:35.556741 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:35.556741 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:35.556741 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:35.556741 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:35.556741 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:35.556741 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:35.556741 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:35.556741 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:35.556741 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:35.556741 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:35.556741 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:35.556741 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:35.556741 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:43:35.557618 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:43:35.557618 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:35.557618 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:35.558127 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 366/702] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:43:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:35.559628 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfde4f93-07e3-44ff-bd42-802c6b451d45 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:35.569125 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1312072-6cea-4af3-a859-c8f0762daa79 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:35.649546 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:35.705910 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfde4f93-07e3-44ff-bd42-802c6b451d45 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:35.779056 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:35.797414 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77343730-c23a-443e-ac28-cc9364d68b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:35.798468 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77343730-c23a-443e-ac28-cc9364d68b55 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:35.799491 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77343730-c23a-443e-ac28-cc9364d68b55 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:35.800023 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77343730-c23a-443e-ac28-cc9364d68b55 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:35.801519 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77343730-c23a-443e-ac28-cc9364d68b55 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:35.804678 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77343730-c23a-443e-ac28-cc9364d68b55 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:35.822959 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1312072-6cea-4af3-a859-c8f0762daa79 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:35.831047 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-77343730-c23a-443e-ac28-cc9364d68b55 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 18 00:43:35.831047 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:35.831047 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 18 00:43:35.831047 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 18 00:43:35.831047 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 18 00:43:35.831047 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 18 00:43:35.831047 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 18 00:43:35.831047 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 00:43:35.831047 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 18 00:43:35.831047 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:35.831047 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 18 00:43:35.831047 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:35.831047 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:35.831047 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:35.831047 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:35.831047 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:35.831047 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:35.832273 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:35.832273 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:35.832273 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:35.832273 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:35.832273 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:35.832273 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:35.832273 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 18 00:43:35.832273 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 18 00:43:35.832273 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 18 00:43:35.832273 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 18 00:43:35.832273 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:35.832273 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:35.832273 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:35.832273 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:35.832273 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:35.832273 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:35.833120 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:35.833120 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:35.833120 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:35.833120 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:35.833120 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:35.833120 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:35.833120 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:35.833120 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:35.833120 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:35.833120 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:35.833120 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 18 00:43:35.833120 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 00:43:35.833120 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 18 00:43:35.833120 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:35.838230 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 337/703] 10.222.0.15 () {56 vars in 1129 bytes} [Sun Sep 18 00:43:35 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:35.849626 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77343730-c23a-443e-ac28-cc9364d68b55 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:35.878609 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf19bb-7562-4d83-8aff-49d0672c33f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:35.879648 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf19bb-7562-4d83-8aff-49d0672c33f6 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:35.880172 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf19bb-7562-4d83-8aff-49d0672c33f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:35.880690 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf19bb-7562-4d83-8aff-49d0672c33f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:35.881579 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acf19bb-7562-4d83-8aff-49d0672c33f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:35.882102 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acf19bb-7562-4d83-8aff-49d0672c33f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:35.883721 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acf19bb-7562-4d83-8aff-49d0672c33f6 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:35.898900 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 367/704] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:43:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:35.911489 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf19bb-7562-4d83-8aff-49d0672c33f6 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:36.077470 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77343730-c23a-443e-ac28-cc9364d68b55 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:36.093889 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf19bb-7562-4d83-8aff-49d0672c33f6 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:36.119481 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:36.125864 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099b71d8-59b3-4d04-9d24-411463f95a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:36.127544 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b71d8-59b3-4d04-9d24-411463f95a05 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:36.127966 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b71d8-59b3-4d04-9d24-411463f95a05 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:36.128354 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b71d8-59b3-4d04-9d24-411463f95a05 None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:36.129133 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099b71d8-59b3-4d04-9d24-411463f95a05 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:36.129656 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099b71d8-59b3-4d04-9d24-411463f95a05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:36.131336 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099b71d8-59b3-4d04-9d24-411463f95a05 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:36.141998 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 338/705] 10.222.0.15 () {56 vars in 1124 bytes} [Sun Sep 18 00:43:35 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:36.141998 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b53481-3fbd-4dfe-934f-3b93fd3de880 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:36.141998 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b53481-3fbd-4dfe-934f-3b93fd3de880 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:36.141998 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b53481-3fbd-4dfe-934f-3b93fd3de880 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:36.141998 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 339/706] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:43:36.143445 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b53481-3fbd-4dfe-934f-3b93fd3de880 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:36.150752 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c190d-2e18-4ea8-a97c-753623372105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:36.152061 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c190d-2e18-4ea8-a97c-753623372105 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:36.152499 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c190d-2e18-4ea8-a97c-753623372105 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:36.152933 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c190d-2e18-4ea8-a97c-753623372105 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:36.163952 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310c190d-2e18-4ea8-a97c-753623372105 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:36.166212 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310c190d-2e18-4ea8-a97c-753623372105 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:36.170304 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:36.188746 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-310c190d-2e18-4ea8-a97c-753623372105 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 18 00:43:36.188746 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:36.188746 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:36.188746 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:36.188746 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:36.188746 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:36.188746 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:36.188746 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:36.188746 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:36.188746 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:36.188746 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:36.188746 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:36.188746 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 00:43:36.188746 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 00:43:36.188746 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 00:43:36.188746 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 00:43:36.190329 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:36.190329 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:36.190329 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 00:43:36.190329 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:43:36.190329 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 00:43:36.190329 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:43:36.190329 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:36.190329 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:36.190329 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:36.190329 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:36.190329 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:36.190329 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:36.190329 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:36.190329 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:36.190329 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:36.190329 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:36.190329 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:36.190329 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:36.191259 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:36.191259 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:36.191259 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 00:43:36.191259 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 00:43:36.191259 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 00:43:36.191259 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 00:43:36.191259 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 00:43:36.191259 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 00:43:36.191259 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 18 00:43:36.191259 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:36.191259 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 368/707] 10.222.0.15 () {56 vars in 1093 bytes} [Sun Sep 18 00:43:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 00:43:36.191259 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98086a-eddc-4f50-ac80-3840cc517af0 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:36.191972 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98086a-eddc-4f50-ac80-3840cc517af0 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:36.191972 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98086a-eddc-4f50-ac80-3840cc517af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:36.225115 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-9e98086a-eddc-4f50-ac80-3840cc517af0 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:43:36.226357 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-9e98086a-eddc-4f50-ac80-3840cc517af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:43:36.288893 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b53481-3fbd-4dfe-934f-3b93fd3de880 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:36.315034 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 369/708] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:43:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 00:43:36.316068 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e98086a-eddc-4f50-ac80-3840cc517af0 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:36.385224 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b1805c-78ff-4bf6-b7af-5d01e231e6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:36.386216 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1805c-78ff-4bf6-b7af-5d01e231e6f8 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:36.386720 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1805c-78ff-4bf6-b7af-5d01e231e6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:36.387217 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1805c-78ff-4bf6-b7af-5d01e231e6f8 None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:36.388578 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b1805c-78ff-4bf6-b7af-5d01e231e6f8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:36.389069 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b1805c-78ff-4bf6-b7af-5d01e231e6f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:36.391770 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b1805c-78ff-4bf6-b7af-5d01e231e6f8 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:36.408689 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 340/709] 10.222.0.15 () {56 vars in 1124 bytes} [Sun Sep 18 00:43:36 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:43:36.451330 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e98086a-eddc-4f50-ac80-3840cc517af0 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:36.492398 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:36.500471 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8b526-b285-4285-88b6-f735a19c5d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:36.501219 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8b526-b285-4285-88b6-f735a19c5d0c None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:36.501520 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8b526-b285-4285-88b6-f735a19c5d0c None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:36.502013 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8b526-b285-4285-88b6-f735a19c5d0c None admin] PATH_INFO: `/v3/users` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:36.502728 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff8b526-b285-4285-88b6-f735a19c5d0c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:36.503041 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff8b526-b285-4285-88b6-f735a19c5d0c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:36.504641 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff8b526-b285-4285-88b6-f735a19c5d0c None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:36.541179 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 370/710] 10.222.0.15 () {56 vars in 1133 bytes} [Sun Sep 18 00:43:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:36.547370 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b1805c-78ff-4bf6-b7af-5d01e231e6f8 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:36.690518 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:36.748773 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8b526-b285-4285-88b6-f735a19c5d0c None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:36.756626 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b1805c-78ff-4bf6-b7af-5d01e231e6f8 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:36.840796 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e40fc9-f237-4305-882d-bf25ea92649b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:36.841461 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e40fc9-f237-4305-882d-bf25ea92649b None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:36.841876 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e40fc9-f237-4305-882d-bf25ea92649b None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:36.842169 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e40fc9-f237-4305-882d-bf25ea92649b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:36.870096 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8b526-b285-4285-88b6-f735a19c5d0c None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:36.910649 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2432f5-c71e-48e2-be4e-c913d4210be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:36.911359 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2432f5-c71e-48e2-be4e-c913d4210be8 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:36.911638 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2432f5-c71e-48e2-be4e-c913d4210be8 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:36.911928 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2432f5-c71e-48e2-be4e-c913d4210be8 None admin] PATH_INFO: `/v3/services/network` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:36.912527 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2432f5-c71e-48e2-be4e-c913d4210be8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:36.913966 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2432f5-c71e-48e2-be4e-c913d4210be8 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:36.926195 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-1a2432f5-c71e-48e2-be4e-c913d4210be8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 18 00:43:36.926195 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:36.926195 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 18 00:43:36.926195 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 18 00:43:36.926195 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 18 00:43:36.926195 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 18 00:43:36.926195 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 18 00:43:36.926195 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 00:43:36.926195 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 18 00:43:36.926195 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:36.926195 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 18 00:43:36.926195 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:36.926195 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:36.926195 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:36.926195 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:36.926195 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:36.926195 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:36.927311 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:36.927311 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:36.927311 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:36.927311 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:36.927311 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:36.927311 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:36.927311 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 18 00:43:36.927311 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 18 00:43:36.927311 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 18 00:43:36.927311 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 18 00:43:36.927311 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:36.927311 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:36.927311 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:36.927311 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:36.927311 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:36.927311 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:36.928208 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:36.928208 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:36.928208 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:36.928208 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:36.928208 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:36.928208 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:36.928208 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:36.928208 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:36.928208 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:36.928208 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:36.928208 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 18 00:43:36.928208 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 00:43:36.928208 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 18 00:43:36.928208 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:36.928208 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 371/711] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Sep 18 00:43:36 2022] GET /identity/v3/services/network => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:36.933698 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2432f5-c71e-48e2-be4e-c913d4210be8 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:36.994690 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:37.015132 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e40fc9-f237-4305-882d-bf25ea92649b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:37.016666 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e40fc9-f237-4305-882d-bf25ea92649b None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:37.081239 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2432f5-c71e-48e2-be4e-c913d4210be8 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:37.135612 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:37.159605 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a25203b-2dd5-449b-bc54-c399606074b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:37.161101 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25203b-2dd5-449b-bc54-c399606074b8 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:37.161632 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25203b-2dd5-449b-bc54-c399606074b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:37.166602 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25203b-2dd5-449b-bc54-c399606074b8 None admin] PATH_INFO: `/v3/services` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:37.167610 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a25203b-2dd5-449b-bc54-c399606074b8 None admin] RBAC: Adding query filter params (name=network) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:37.168147 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a25203b-2dd5-449b-bc54-c399606074b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:37.169763 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a25203b-2dd5-449b-bc54-c399606074b8 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:37.179972 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 372/712] 10.222.0.15 () {56 vars in 1112 bytes} [Sun Sep 18 00:43:36 2022] GET /identity/v3/services?name=network => generated 124 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:37.185799 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a25203b-2dd5-449b-bc54-c399606074b8 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:37.238105 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 341/713] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Sep 18 00:43:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 691 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 00:43:37.244090 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e40fc9-f237-4305-882d-bf25ea92649b None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:37.343411 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a25203b-2dd5-449b-bc54-c399606074b8 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:37.376787 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:37.411696 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e353a-ffe8-47cf-a705-7fa567657fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:37.411696 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e353a-ffe8-47cf-a705-7fa567657fdc None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:37.411696 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e353a-ffe8-47cf-a705-7fa567657fdc None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:37.411696 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e353a-ffe8-47cf-a705-7fa567657fdc None admin] PATH_INFO: `/v3/services` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:37.412216 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66e353a-ffe8-47cf-a705-7fa567657fdc None admin] RBAC: Adding query filter params (type=network) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:37.412216 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66e353a-ffe8-47cf-a705-7fa567657fdc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:37.416088 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66e353a-ffe8-47cf-a705-7fa567657fdc None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:37.435955 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 373/714] 10.222.0.15 () {56 vars in 1112 bytes} [Sun Sep 18 00:43:37 2022] GET /identity/v3/services?type=network => generated 124 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:37.491547 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e242a-2fe5-4d49-8003-a8be2eef9dc3 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:37.492048 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e242a-2fe5-4d49-8003-a8be2eef9dc3 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:37.492538 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e242a-2fe5-4d49-8003-a8be2eef9dc3 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:37.492828 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e40fc9-f237-4305-882d-bf25ea92649b None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:37.500103 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 374/715] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:43:37 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:43:37.509598 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f51445-22b3-48f0-a593-968fe7d8d774 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:37.510493 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f51445-22b3-48f0-a593-968fe7d8d774 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:37.511001 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f51445-22b3-48f0-a593-968fe7d8d774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:37.548866 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3909262a-afed-4754-888c-15611307d128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:37.549872 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909262a-afed-4754-888c-15611307d128 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:37.550503 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909262a-afed-4754-888c-15611307d128 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:37.550949 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909262a-afed-4754-888c-15611307d128 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:37.560781 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-79f51445-22b3-48f0-a593-968fe7d8d774 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:43:37.564045 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-79f51445-22b3-48f0-a593-968fe7d8d774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:43:37.580853 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3909262a-afed-4754-888c-15611307d128 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:37.582792 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3909262a-afed-4754-888c-15611307d128 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:37.613373 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-3909262a-afed-4754-888c-15611307d128 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:37.613373 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:37.613373 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:37.613373 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:37.613373 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:37.613373 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:37.613373 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:37.613373 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:37.613373 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:37.613373 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:37.613373 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:37.613373 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:37.613373 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:43:37.613373 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:43:37.613373 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:43:37.613373 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:43:37.614512 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:37.614512 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:37.614512 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:37.614512 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:37.614512 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:37.614512 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:37.614512 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:37.614512 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:37.614512 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:37.614512 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:37.614512 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:37.614512 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:37.614512 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:37.614512 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:37.614512 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:37.614512 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:37.614512 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:43:37.615388 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:43:37.615388 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:37.615388 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:37.622342 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 342/716] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:43:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 00:43:37.631710 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3909262a-afed-4754-888c-15611307d128 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:37.659486 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:37.761567 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 375/717] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:43:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 00:43:37.799839 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3909262a-afed-4754-888c-15611307d128 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:37.800264 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc4ac1-4b47-4755-ae00-9605a2a8e9d8 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:37.800653 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc4ac1-4b47-4755-ae00-9605a2a8e9d8 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:37.801268 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc4ac1-4b47-4755-ae00-9605a2a8e9d8 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:37.808395 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 376/718] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:43:37 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:43:37.813965 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f86d2-3c76-4d66-a36e-a44c5f0bbf5a None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:37.814854 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f86d2-3c76-4d66-a36e-a44c5f0bbf5a None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:37.815089 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f86d2-3c76-4d66-a36e-a44c5f0bbf5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:37.849359 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eef6cf-ff48-4218-a99d-79959e82ff4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:37.850040 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eef6cf-ff48-4218-a99d-79959e82ff4f None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:37.850392 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eef6cf-ff48-4218-a99d-79959e82ff4f None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:37.850731 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eef6cf-ff48-4218-a99d-79959e82ff4f None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:37.851398 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eef6cf-ff48-4218-a99d-79959e82ff4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:37.851705 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eef6cf-ff48-4218-a99d-79959e82ff4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:37.851807 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-db0f86d2-3c76-4d66-a36e-a44c5f0bbf5a None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:43:37.853163 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eef6cf-ff48-4218-a99d-79959e82ff4f None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:37.853555 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-db0f86d2-3c76-4d66-a36e-a44c5f0bbf5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:43:37.874378 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 343/719] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:43:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:43:37.883582 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eef6cf-ff48-4218-a99d-79959e82ff4f None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:37.952829 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 377/720] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:43:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 18 00:43:38.028497 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:38.043167 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eef6cf-ff48-4218-a99d-79959e82ff4f None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:38.082261 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b243ff-49b4-440b-9038-ed68ec8c270c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:38.082990 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b243ff-49b4-440b-9038-ed68ec8c270c None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:38.083278 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b243ff-49b4-440b-9038-ed68ec8c270c None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:38.083556 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b243ff-49b4-440b-9038-ed68ec8c270c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:38.091400 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b243ff-49b4-440b-9038-ed68ec8c270c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:38.092997 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b243ff-49b4-440b-9038-ed68ec8c270c None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:38.105742 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-78b243ff-49b4-440b-9038-ed68ec8c270c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:43:38.105742 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:38.105742 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:38.105742 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:38.105742 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:38.105742 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:38.105742 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:38.105742 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:38.105742 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:38.105742 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:38.105742 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:38.105742 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:38.105742 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 00:43:38.105742 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 00:43:38.105742 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 00:43:38.106683 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 00:43:38.106683 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:38.106683 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:38.106683 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:38.106683 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:38.106683 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:38.106683 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:38.106683 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:38.106683 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:38.106683 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:38.106683 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:38.106683 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:38.106683 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:38.106683 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:38.106683 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:38.106683 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:38.106683 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:38.107539 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 00:43:38.107539 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 00:43:38.107539 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 00:43:38.107539 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 00:43:38.107539 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 00:43:38.107539 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 00:43:38.107539 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:43:38.107539 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:38.107539 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 344/721] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Sep 18 00:43:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:38.116490 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0f86d2-3c76-4d66-a36e-a44c5f0bbf5a None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:38.167305 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:38.255731 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b243ff-49b4-440b-9038-ed68ec8c270c None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:38.258189 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0f86d2-3c76-4d66-a36e-a44c5f0bbf5a None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:38.310276 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbbb083-a8ef-4a3e-9d91-266cf701ecf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:38.310923 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbbb083-a8ef-4a3e-9d91-266cf701ecf0 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:38.311320 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbbb083-a8ef-4a3e-9d91-266cf701ecf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:38.311607 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbbb083-a8ef-4a3e-9d91-266cf701ecf0 None admin] PATH_INFO: `/v3/projects` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:38.312345 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbbb083-a8ef-4a3e-9d91-266cf701ecf0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:38.312660 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbbb083-a8ef-4a3e-9d91-266cf701ecf0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:38.314107 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbbb083-a8ef-4a3e-9d91-266cf701ecf0 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:38.327821 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 378/722] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Sep 18 00:43:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:38.335196 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbbb083-a8ef-4a3e-9d91-266cf701ecf0 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:38.463955 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b243ff-49b4-440b-9038-ed68ec8c270c None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:38.476376 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbbb083-a8ef-4a3e-9d91-266cf701ecf0 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:38.480626 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:38.503185 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:38.510434 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770021e3-5551-4e72-a298-d11a2a9c247a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:38.512095 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770021e3-5551-4e72-a298-d11a2a9c247a None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:38.512507 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770021e3-5551-4e72-a298-d11a2a9c247a None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:38.513227 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770021e3-5551-4e72-a298-d11a2a9c247a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:38.522650 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3db717c-c8ee-467a-b83e-aee7c0626e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:38.523686 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db717c-c8ee-467a-b83e-aee7c0626e60 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:38.524165 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db717c-c8ee-467a-b83e-aee7c0626e60 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:38.524592 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db717c-c8ee-467a-b83e-aee7c0626e60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:38.525583 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3db717c-c8ee-467a-b83e-aee7c0626e60 None admin] RBAC: Adding query filter params (role.id=591d4711dc204cf98003c8b7d7558506, scope.project.id=52ebde8fa3f84ede9ef575f7c0780798, user.id=264c183fff8a49478eea4aceea73273e) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:38.526049 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3db717c-c8ee-467a-b83e-aee7c0626e60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:38.527470 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770021e3-5551-4e72-a298-d11a2a9c247a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:43:38.527864 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3db717c-c8ee-467a-b83e-aee7c0626e60 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:38.533519 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-770021e3-5551-4e72-a298-d11a2a9c247a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 18 00:43:38.533519 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:38.533519 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:38.533519 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:38.533519 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:38.533519 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:38.533519 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:38.533519 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:38.533519 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:38.533519 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:38.533519 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:38.533519 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:38.533519 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:43:38.533519 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:43:38.533519 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:43:38.533519 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:43:38.534730 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:43:38.534730 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:43:38.534730 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:43:38.534730 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:43:38.534730 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:38.534730 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:38.534730 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:38.534730 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:38.534730 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:38.534730 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:38.534730 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:38.534730 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:38.534730 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:38.534730 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:38.534730 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:38.534730 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:38.535777 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:38.535777 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:38.535777 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:38.535777 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:38.535777 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:43:38.535777 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:43:38.535777 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:43:38.535777 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:43:38.535777 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:43:38.535777 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:43:38.535777 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 18 00:43:38.535777 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:38.537072 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 345/723] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Sep 18 00:43:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 00:43:38.537762 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770021e3-5551-4e72-a298-d11a2a9c247a None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:38.538443 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 379/724] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Sep 18 00:43:38 2022] GET /identity/v3/role_assignments?user.id=264c183fff8a49478eea4aceea73273e&scope.project.id=52ebde8fa3f84ede9ef575f7c0780798&role.id=591d4711dc204cf98003c8b7d7558506 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:38.545483 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3db717c-c8ee-467a-b83e-aee7c0626e60 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:38.801829 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770021e3-5551-4e72-a298-d11a2a9c247a None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:38.803280 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3db717c-c8ee-467a-b83e-aee7c0626e60 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:38.850343 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6d15d-5657-4975-a761-c164cf57cdc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:38.851434 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6d15d-5657-4975-a761-c164cf57cdc0 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:38.853256 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6d15d-5657-4975-a761-c164cf57cdc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:38.853755 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6d15d-5657-4975-a761-c164cf57cdc0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:38.880289 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae6d15d-5657-4975-a761-c164cf57cdc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:43:38.886660 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-4ae6d15d-5657-4975-a761-c164cf57cdc0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 00:43:38.886660 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:38.886660 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:38.886660 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:38.886660 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:38.886660 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:38.886660 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:38.886660 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:38.886660 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:38.886660 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:38.886660 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:38.886660 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:38.886660 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:43:38.886660 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:43:38.886660 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:43:38.886660 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:43:38.887654 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:43:38.887654 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:43:38.887654 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:43:38.887654 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:43:38.887654 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:38.887654 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:38.887654 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:38.887654 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:38.887654 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:38.887654 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:38.887654 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:38.887654 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:38.887654 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:38.887654 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:38.887654 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:38.887654 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:38.888540 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:38.888540 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:38.888540 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:38.888540 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:38.888540 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:43:38.888540 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:43:38.888540 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:43:38.888540 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:43:38.888540 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:43:38.888540 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:43:38.888540 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 00:43:38.888540 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:38.890251 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8619c535-84ed-427b-bf26-1639b3ee79ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:38.891133 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8619c535-84ed-427b-bf26-1639b3ee79ce None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:38.891680 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8619c535-84ed-427b-bf26-1639b3ee79ce None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:38.892180 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8619c535-84ed-427b-bf26-1639b3ee79ce None admin] PATH_INFO: `/v3/roles` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:38.893631 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8619c535-84ed-427b-bf26-1639b3ee79ce None admin] RBAC: Adding query filter params (name=service) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:38.894169 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8619c535-84ed-427b-bf26-1639b3ee79ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:38.895776 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8619c535-84ed-427b-bf26-1639b3ee79ce None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:38.897710 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 346/725] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Sep 18 00:43:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:38.903514 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6d15d-5657-4975-a761-c164cf57cdc0 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:38.907057 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 380/726] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Sep 18 00:43:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:38.913128 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8619c535-84ed-427b-bf26-1639b3ee79ce None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:38.949998 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:39.024455 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:39.109688 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8619c535-84ed-427b-bf26-1639b3ee79ce None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:39.149634 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0009c298-68b2-4998-a5ef-de83c4054554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:39.150289 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0009c298-68b2-4998-a5ef-de83c4054554 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:39.150593 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0009c298-68b2-4998-a5ef-de83c4054554 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:39.150853 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0009c298-68b2-4998-a5ef-de83c4054554 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:39.154224 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6d15d-5657-4975-a761-c164cf57cdc0 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:39.165071 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0009c298-68b2-4998-a5ef-de83c4054554 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:39.167363 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0009c298-68b2-4998-a5ef-de83c4054554 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:39.184679 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-0009c298-68b2-4998-a5ef-de83c4054554 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:39.184679 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:39.184679 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:39.184679 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:39.184679 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:39.184679 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:39.184679 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:39.184679 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:39.184679 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:39.184679 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:39.184679 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:39.184679 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:39.184679 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:43:39.184679 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:43:39.184679 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:43:39.184679 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:43:39.186558 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:39.186558 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:39.186558 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:39.186558 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:39.186558 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:39.186558 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:39.186558 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:39.186558 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:39.186558 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:39.186558 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:39.186558 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:39.186558 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:39.186558 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:39.186558 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:39.186558 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:39.186558 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:39.186558 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:43:39.190159 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:43:39.190159 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:39.190159 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:39.190159 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 381/727] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:43:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 00:43:39.200876 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0009c298-68b2-4998-a5ef-de83c4054554 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:39.264563 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915f03f2-e1e9-493a-aeb1-c032ff958c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:39.266126 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f03f2-e1e9-493a-aeb1-c032ff958c3f None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:39.266936 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f03f2-e1e9-493a-aeb1-c032ff958c3f None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:39.267803 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f03f2-e1e9-493a-aeb1-c032ff958c3f None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:39.270817 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915f03f2-e1e9-493a-aeb1-c032ff958c3f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:39.271724 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915f03f2-e1e9-493a-aeb1-c032ff958c3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:39.275006 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915f03f2-e1e9-493a-aeb1-c032ff958c3f None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:39.317981 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 347/728] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Sep 18 00:43:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:43:39.324084 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915f03f2-e1e9-493a-aeb1-c032ff958c3f None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:39.445228 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:39.460140 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0009c298-68b2-4998-a5ef-de83c4054554 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:39.531013 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f6175-1d98-43e6-8de1-b944a714790f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:39.532626 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f6175-1d98-43e6-8de1-b944a714790f None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:39.533651 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f6175-1d98-43e6-8de1-b944a714790f None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:39.534416 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f6175-1d98-43e6-8de1-b944a714790f None admin] PATH_INFO: `/v3/domains` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:39.535916 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435f6175-1d98-43e6-8de1-b944a714790f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:39.536910 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435f6175-1d98-43e6-8de1-b944a714790f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:39.540255 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435f6175-1d98-43e6-8de1-b944a714790f None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:39.566044 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 382/729] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:43:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:43:39.575542 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f6175-1d98-43e6-8de1-b944a714790f None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:39.686738 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915f03f2-e1e9-493a-aeb1-c032ff958c3f None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:39.713445 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:39.757388 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f6175-1d98-43e6-8de1-b944a714790f None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:39.763470 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ca813-af79-43cd-ae20-6ff387c3a22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:39.764160 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ca813-af79-43cd-ae20-6ff387c3a22a None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:39.764441 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ca813-af79-43cd-ae20-6ff387c3a22a None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:39.764706 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ca813-af79-43cd-ae20-6ff387c3a22a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:39.786100 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35ca813-af79-43cd-ae20-6ff387c3a22a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:39.787611 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35ca813-af79-43cd-ae20-6ff387c3a22a None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:39.812467 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-a35ca813-af79-43cd-ae20-6ff387c3a22a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:39.812467 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:39.812467 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:39.812467 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:39.812467 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:39.812467 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:39.812467 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:39.812467 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:39.812467 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:39.812467 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:39.812467 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:39.812467 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:39.812467 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:43:39.812467 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:43:39.812467 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:43:39.812467 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:43:39.813458 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:39.813458 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:39.813458 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:39.813458 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:39.813458 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:39.813458 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:39.813458 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:39.813458 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:39.813458 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:39.813458 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:39.813458 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:39.813458 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:39.813458 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:39.813458 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:39.813458 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:39.813458 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:39.813458 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:43:39.814867 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:43:39.814867 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:39.814867 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:39.814867 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 348/730] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:43:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 491 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:39.815105 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42df744e-2350-4fd5-b361-f71c58350620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:39.819921 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df744e-2350-4fd5-b361-f71c58350620 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:39.819921 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df744e-2350-4fd5-b361-f71c58350620 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:39.819921 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df744e-2350-4fd5-b361-f71c58350620 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:39.822634 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ca813-af79-43cd-ae20-6ff387c3a22a None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:39.829623 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42df744e-2350-4fd5-b361-f71c58350620 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:39.831212 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42df744e-2350-4fd5-b361-f71c58350620 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:39.833345 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:39.852034 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-42df744e-2350-4fd5-b361-f71c58350620 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 18 00:43:39.852034 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:39.852034 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:39.852034 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:39.852034 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:39.852034 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:39.852034 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:39.852034 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:39.852034 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:39.852034 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:39.852034 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:39.852034 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:39.852034 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 00:43:39.852034 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 00:43:39.852034 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 00:43:39.852034 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 00:43:39.854348 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:39.854348 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:39.854348 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 00:43:39.854348 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:43:39.854348 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 00:43:39.854348 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:43:39.854348 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:39.854348 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:39.854348 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:39.854348 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:39.854348 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:39.854348 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:39.854348 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:39.854348 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:39.854348 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:39.854348 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:39.854348 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:39.854348 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:39.856575 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:39.856575 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:39.856575 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 00:43:39.856575 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 00:43:39.856575 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 00:43:39.856575 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 00:43:39.856575 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 00:43:39.856575 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 00:43:39.856575 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 18 00:43:39.856575 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:39.856575 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 383/731] 10.222.0.15 () {56 vars in 1117 bytes} [Sun Sep 18 00:43:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:39.863720 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42df744e-2350-4fd5-b361-f71c58350620 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:40.039787 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ca813-af79-43cd-ae20-6ff387c3a22a None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:40.042011 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42df744e-2350-4fd5-b361-f71c58350620 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:40.085658 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214fcb59-2d24-4034-9d17-ebfdf7eb3cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:40.086764 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214fcb59-2d24-4034-9d17-ebfdf7eb3cdd None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:40.087305 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214fcb59-2d24-4034-9d17-ebfdf7eb3cdd None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:40.087786 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214fcb59-2d24-4034-9d17-ebfdf7eb3cdd None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:40.088767 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214fcb59-2d24-4034-9d17-ebfdf7eb3cdd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:40.089287 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214fcb59-2d24-4034-9d17-ebfdf7eb3cdd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:40.090921 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214fcb59-2d24-4034-9d17-ebfdf7eb3cdd None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:40.108098 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 349/732] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:43:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:40.109871 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a40344e-e2d3-4eb1-833b-b7fc7931ad51 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:40.110383 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a40344e-e2d3-4eb1-833b-b7fc7931ad51 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:40.110893 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a40344e-e2d3-4eb1-833b-b7fc7931ad51 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:40.114708 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 350/733] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:43:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:43:40.116467 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a40344e-e2d3-4eb1-833b-b7fc7931ad51 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:40.130547 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d1b9d-6dc9-4b39-8239-3b0ba0fd4097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:40.131673 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d1b9d-6dc9-4b39-8239-3b0ba0fd4097 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:40.132282 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d1b9d-6dc9-4b39-8239-3b0ba0fd4097 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:40.133564 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d1b9d-6dc9-4b39-8239-3b0ba0fd4097 None admin] PATH_INFO: `/v3/users` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:40.135786 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9d1b9d-6dc9-4b39-8239-3b0ba0fd4097 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:40.136919 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9d1b9d-6dc9-4b39-8239-3b0ba0fd4097 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:40.140131 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9d1b9d-6dc9-4b39-8239-3b0ba0fd4097 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:40.157787 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:40.187474 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 384/734] 10.222.0.15 () {56 vars in 1149 bytes} [Sun Sep 18 00:43:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:40.189795 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7ca9c-9a18-401a-9162-45e03d0edc4c None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:40.190362 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7ca9c-9a18-401a-9162-45e03d0edc4c None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:40.190863 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7ca9c-9a18-401a-9162-45e03d0edc4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:40.212741 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-bbf7ca9c-9a18-401a-9162-45e03d0edc4c None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:43:40.214315 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-bbf7ca9c-9a18-401a-9162-45e03d0edc4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:43:40.295796 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a40344e-e2d3-4eb1-833b-b7fc7931ad51 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:40.315424 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:40.337983 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafd1647-7b03-43a8-8a4f-51c578c4bea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:40.338726 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd1647-7b03-43a8-8a4f-51c578c4bea4 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:40.339107 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd1647-7b03-43a8-8a4f-51c578c4bea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:40.339485 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd1647-7b03-43a8-8a4f-51c578c4bea4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:40.348224 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafd1647-7b03-43a8-8a4f-51c578c4bea4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:40.349802 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafd1647-7b03-43a8-8a4f-51c578c4bea4 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:40.355041 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 385/735] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:43:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 00:43:40.363413 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf7ca9c-9a18-401a-9162-45e03d0edc4c None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:40.369046 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-eafd1647-7b03-43a8-8a4f-51c578c4bea4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 18 00:43:40.369046 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:40.369046 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:40.369046 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:40.369046 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:40.369046 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:40.369046 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:40.369046 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:40.369046 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:40.369046 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:40.369046 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:40.369046 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:40.369046 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 00:43:40.369046 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 00:43:40.369046 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 00:43:40.369046 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 00:43:40.371569 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:40.371569 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:40.371569 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 00:43:40.371569 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:43:40.371569 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 00:43:40.371569 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:43:40.371569 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:40.371569 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:40.371569 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:40.371569 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:40.371569 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:40.371569 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:40.371569 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:40.371569 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:40.371569 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:40.371569 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:40.371569 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:40.371569 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:40.373841 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:40.373841 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:40.373841 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 00:43:40.373841 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 00:43:40.373841 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 00:43:40.373841 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 00:43:40.373841 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 00:43:40.373841 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 00:43:40.373841 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 18 00:43:40.373841 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:40.373841 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 351/736] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Sep 18 00:43:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:40.380422 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b1426-bd0d-4103-8df4-99d248a1fbe9 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:40.380422 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b1426-bd0d-4103-8df4-99d248a1fbe9 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:40.380422 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b1426-bd0d-4103-8df4-99d248a1fbe9 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:40.380422 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 352/737] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:43:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:43:40.380422 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b1426-bd0d-4103-8df4-99d248a1fbe9 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:40.495498 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf7ca9c-9a18-401a-9162-45e03d0edc4c None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:40.512952 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:40.532496 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b1426-bd0d-4103-8df4-99d248a1fbe9 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:40.541247 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648f07d-4ca1-49f0-bc1b-3b6eafdf8929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:40.542593 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648f07d-4ca1-49f0-bc1b-3b6eafdf8929 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:40.543091 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648f07d-4ca1-49f0-bc1b-3b6eafdf8929 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:40.543579 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648f07d-4ca1-49f0-bc1b-3b6eafdf8929 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:40.577930 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd90e250-ea83-43e5-8fe9-2a5a7863d682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:40.578481 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd90e250-ea83-43e5-8fe9-2a5a7863d682 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:40.578765 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd90e250-ea83-43e5-8fe9-2a5a7863d682 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:40.579041 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd90e250-ea83-43e5-8fe9-2a5a7863d682 None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:40.580355 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd90e250-ea83-43e5-8fe9-2a5a7863d682 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:40.580667 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd90e250-ea83-43e5-8fe9-2a5a7863d682 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:40.582752 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd90e250-ea83-43e5-8fe9-2a5a7863d682 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:40.612095 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 353/738] 10.222.0.15 () {56 vars in 1135 bytes} [Sun Sep 18 00:43:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:40.613893 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615b405-1ab9-4e76-937f-2caa1a0cf098 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:40.614182 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615b405-1ab9-4e76-937f-2caa1a0cf098 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:40.614457 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615b405-1ab9-4e76-937f-2caa1a0cf098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:40.619494 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:40.635986 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1648f07d-4ca1-49f0-bc1b-3b6eafdf8929 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:40.637691 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-3615b405-1ab9-4e76-937f-2caa1a0cf098 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:43:40.638056 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1648f07d-4ca1-49f0-bc1b-3b6eafdf8929 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:40.638919 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-3615b405-1ab9-4e76-937f-2caa1a0cf098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:43:40.739921 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 354/739] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:43:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 18 00:43:40.739921 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3615b405-1ab9-4e76-937f-2caa1a0cf098 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:40.786648 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 386/740] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Sep 18 00:43:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 00:43:40.793567 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648f07d-4ca1-49f0-bc1b-3b6eafdf8929 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:40.844565 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:40.883975 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3615b405-1ab9-4e76-937f-2caa1a0cf098 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:40.919627 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0138ccc-f57c-4b57-9495-9604ae867ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:40.920298 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0138ccc-f57c-4b57-9495-9604ae867ab5 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:40.920592 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0138ccc-f57c-4b57-9495-9604ae867ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:40.920847 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0138ccc-f57c-4b57-9495-9604ae867ab5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:40.988382 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:41.018992 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648f07d-4ca1-49f0-bc1b-3b6eafdf8929 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:41.025011 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0138ccc-f57c-4b57-9495-9604ae867ab5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:41.028730 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0138ccc-f57c-4b57-9495-9604ae867ab5 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:41.078998 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf77c6eb-8614-4826-a77f-cb2501ea6ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:41.082184 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77c6eb-8614-4826-a77f-cb2501ea6ae9 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:41.082693 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77c6eb-8614-4826-a77f-cb2501ea6ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:41.083185 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77c6eb-8614-4826-a77f-cb2501ea6ae9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:41.107144 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf77c6eb-8614-4826-a77f-cb2501ea6ae9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:41.109830 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf77c6eb-8614-4826-a77f-cb2501ea6ae9 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:41.126319 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:41.139831 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-bf77c6eb-8614-4826-a77f-cb2501ea6ae9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:41.139831 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:41.139831 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:41.139831 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:41.139831 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:41.139831 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:41.139831 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:41.139831 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:41.139831 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:41.139831 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:41.139831 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:41.139831 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:41.139831 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:43:41.139831 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:43:41.139831 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:43:41.139831 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:43:41.140864 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:41.140864 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:41.140864 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:41.140864 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:41.140864 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:41.140864 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:41.140864 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:41.140864 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:41.140864 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:41.140864 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:41.140864 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:41.140864 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:41.140864 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:41.140864 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:41.140864 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:41.140864 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:41.140864 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:43:41.141747 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:43:41.141747 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:41.141747 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:41.143219 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 387/741] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:43:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:41.144554 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf77c6eb-8614-4826-a77f-cb2501ea6ae9 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:41.167610 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 355/742] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Sep 18 00:43:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 18 00:43:41.167610 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0138ccc-f57c-4b57-9495-9604ae867ab5 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:41.300718 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf77c6eb-8614-4826-a77f-cb2501ea6ae9 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:41.306988 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0138ccc-f57c-4b57-9495-9604ae867ab5 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:41.348693 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872afe78-34d4-44d1-9bae-1d848d83b6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:41.349316 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872afe78-34d4-44d1-9bae-1d848d83b6d2 None admin] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:41.349600 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872afe78-34d4-44d1-9bae-1d848d83b6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:41.349989 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872afe78-34d4-44d1-9bae-1d848d83b6d2 None admin] PATH_INFO: `/v3/services` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:41.350640 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872afe78-34d4-44d1-9bae-1d848d83b6d2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:41.352012 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872afe78-34d4-44d1-9bae-1d848d83b6d2 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:41.352668 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ae64d2-69c9-4c1d-8a15-0c024d6f03c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:41.353292 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae64d2-69c9-4c1d-8a15-0c024d6f03c3 None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:41.353589 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae64d2-69c9-4c1d-8a15-0c024d6f03c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:41.353837 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae64d2-69c9-4c1d-8a15-0c024d6f03c3 None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:41.354509 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ae64d2-69c9-4c1d-8a15-0c024d6f03c3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:41.355933 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ae64d2-69c9-4c1d-8a15-0c024d6f03c3 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:41.365238 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:41.373188 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 356/743] 10.222.0.15 () {60 vars in 1141 bytes} [Sun Sep 18 00:43:41 2022] POST /identity/v3/services => generated 240 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 00:43:41.380004 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 388/744] 10.222.0.15 () {60 vars in 1141 bytes} [Sun Sep 18 00:43:41 2022] POST /identity/v3/services => generated 251 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 00:43:41.380004 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872afe78-34d4-44d1-9bae-1d848d83b6d2 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:41.380342 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ae64d2-69c9-4c1d-8a15-0c024d6f03c3 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:41.460095 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:41.638055 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ae64d2-69c9-4c1d-8a15-0c024d6f03c3 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:41.660626 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872afe78-34d4-44d1-9bae-1d848d83b6d2 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:41.698329 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e0ad0-76d0-47a0-8ea3-b930946ce284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:41.699102 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e0ad0-76d0-47a0-8ea3-b930946ce284 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:41.700627 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e0ad0-76d0-47a0-8ea3-b930946ce284 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:41.700827 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e0ad0-76d0-47a0-8ea3-b930946ce284 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:41.702992 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130e0ad0-76d0-47a0-8ea3-b930946ce284 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:41.704612 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130e0ad0-76d0-47a0-8ea3-b930946ce284 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:41.704918 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130e0ad0-76d0-47a0-8ea3-b930946ce284 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:41.726254 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5212e96c-c753-4a43-94ff-9fa7cf5e549d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:41.728262 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212e96c-c753-4a43-94ff-9fa7cf5e549d None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:41.728856 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212e96c-c753-4a43-94ff-9fa7cf5e549d None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:41.729335 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212e96c-c753-4a43-94ff-9fa7cf5e549d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:41.730927 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 357/745] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:43:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:41.741572 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e0ad0-76d0-47a0-8ea3-b930946ce284 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:41.768950 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5212e96c-c753-4a43-94ff-9fa7cf5e549d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:41.770658 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5212e96c-c753-4a43-94ff-9fa7cf5e549d None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:41.797645 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-5212e96c-c753-4a43-94ff-9fa7cf5e549d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:41.797645 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:41.797645 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:41.797645 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:41.797645 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:41.797645 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:41.797645 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:41.797645 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:41.797645 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:41.797645 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:41.797645 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:41.797645 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:41.797645 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:43:41.797645 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:43:41.797645 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:43:41.797645 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:43:41.800120 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:41.800120 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:41.800120 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:41.800120 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:41.800120 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:41.800120 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:41.800120 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:41.800120 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:41.800120 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:41.800120 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:41.800120 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:41.800120 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:41.800120 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:41.800120 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:41.800120 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:41.800120 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:41.800120 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:43:41.801932 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:43:41.801932 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:41.801932 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:41.806241 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 389/746] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:43:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 430 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:41.808847 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5212e96c-c753-4a43-94ff-9fa7cf5e549d None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:41.941387 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:42.014131 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:42.065428 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e0ad0-76d0-47a0-8ea3-b930946ce284 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:42.104085 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5212e96c-c753-4a43-94ff-9fa7cf5e549d None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:42.175857 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4614938a-64d4-487e-a0a8-0ca1bfbdcba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:42.177689 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614938a-64d4-487e-a0a8-0ca1bfbdcba1 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:42.177689 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614938a-64d4-487e-a0a8-0ca1bfbdcba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:42.177689 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614938a-64d4-487e-a0a8-0ca1bfbdcba1 None admin] PATH_INFO: `/v3/domains` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:42.180504 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4614938a-64d4-487e-a0a8-0ca1bfbdcba1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:42.180828 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4614938a-64d4-487e-a0a8-0ca1bfbdcba1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:42.192055 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4614938a-64d4-487e-a0a8-0ca1bfbdcba1 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:42.218732 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 390/747] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:43:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:42.220257 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1124c96c-a17a-4de2-b324-4af882b669dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:42.221731 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124c96c-a17a-4de2-b324-4af882b669dc None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:42.222502 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124c96c-a17a-4de2-b324-4af882b669dc None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:42.223241 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124c96c-a17a-4de2-b324-4af882b669dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:42.231928 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4614938a-64d4-487e-a0a8-0ca1bfbdcba1 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:42.255929 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1124c96c-a17a-4de2-b324-4af882b669dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:42.259378 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1124c96c-a17a-4de2-b324-4af882b669dc None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:42.309151 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-1124c96c-a17a-4de2-b324-4af882b669dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:43:42.309151 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:42.309151 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:42.309151 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:42.309151 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:42.309151 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:42.309151 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:42.309151 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:42.309151 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:42.309151 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:42.309151 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:42.309151 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:42.309151 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 00:43:42.309151 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 00:43:42.309151 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 00:43:42.310687 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 00:43:42.310687 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:42.310687 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:42.310687 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:42.310687 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:42.310687 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:42.310687 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:42.310687 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:42.310687 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:42.310687 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:42.310687 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:42.310687 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:42.310687 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:42.310687 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:42.310687 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:42.310687 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:42.310687 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:42.312303 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 00:43:42.312303 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 00:43:42.312303 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 00:43:42.312303 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 00:43:42.312303 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 00:43:42.312303 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 00:43:42.312303 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:43:42.312303 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:42.317847 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 358/748] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Sep 18 00:43:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 578 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 00:43:42.320490 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f27e5-ef8a-49b7-ac29-705cef9a47f1 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:42.321561 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f27e5-ef8a-49b7-ac29-705cef9a47f1 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:42.322237 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f27e5-ef8a-49b7-ac29-705cef9a47f1 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:42.325722 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 359/749] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:43:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:43:42.327394 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f27e5-ef8a-49b7-ac29-705cef9a47f1 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:42.407467 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4614938a-64d4-487e-a0a8-0ca1bfbdcba1 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:42.418209 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:42.483052 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d09bea-1298-4fcf-9d2a-1168d44d9abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:42.484344 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d09bea-1298-4fcf-9d2a-1168d44d9abb None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:42.484912 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d09bea-1298-4fcf-9d2a-1168d44d9abb None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:42.485477 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d09bea-1298-4fcf-9d2a-1168d44d9abb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:42.498347 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d09bea-1298-4fcf-9d2a-1168d44d9abb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:42.501302 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d09bea-1298-4fcf-9d2a-1168d44d9abb None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:42.525438 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-23d09bea-1298-4fcf-9d2a-1168d44d9abb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:43:42.525438 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:42.525438 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:42.525438 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:42.525438 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:42.525438 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:42.525438 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:42.525438 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:42.525438 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:42.525438 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:42.525438 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:42.525438 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:42.525438 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 00:43:42.525438 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 00:43:42.525438 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 00:43:42.527421 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 00:43:42.527421 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:42.527421 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:42.527421 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:42.527421 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:42.527421 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:42.527421 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:42.527421 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:42.527421 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:42.527421 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:42.527421 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:42.527421 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:42.527421 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:42.527421 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:42.527421 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:42.527421 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:42.527421 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:42.529518 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 00:43:42.529518 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 00:43:42.529518 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 00:43:42.529518 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 00:43:42.529518 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 00:43:42.529518 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 00:43:42.529518 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:43:42.529518 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:42.531768 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 391/750] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Sep 18 00:43:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:42.534782 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ca2ca-45e4-4e7b-add1-d04bf31c033f None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:42.535410 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ca2ca-45e4-4e7b-add1-d04bf31c033f None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:42.536072 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ca2ca-45e4-4e7b-add1-d04bf31c033f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:42.563437 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f27e5-ef8a-49b7-ac29-705cef9a47f1 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:42.571811 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-d28ca2ca-45e4-4e7b-add1-d04bf31c033f None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:43:42.573995 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-d28ca2ca-45e4-4e7b-add1-d04bf31c033f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:43:42.633474 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30557f1-f16e-465f-b1bb-a723326a220b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:42.634769 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30557f1-f16e-465f-b1bb-a723326a220b None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:42.635343 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30557f1-f16e-465f-b1bb-a723326a220b None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:42.635983 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30557f1-f16e-465f-b1bb-a723326a220b None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:42.637502 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30557f1-f16e-465f-b1bb-a723326a220b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:42.638129 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30557f1-f16e-465f-b1bb-a723326a220b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:42.640920 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30557f1-f16e-465f-b1bb-a723326a220b None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:42.665218 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 360/751] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Sep 18 00:43:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:42.667139 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30557f1-f16e-465f-b1bb-a723326a220b None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:42.691746 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:42.709717 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 392/752] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:43:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 00:43:42.711492 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ca2ca-45e4-4e7b-add1-d04bf31c033f None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:42.893894 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:42.904361 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ca2ca-45e4-4e7b-add1-d04bf31c033f None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:42.918402 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30557f1-f16e-465f-b1bb-a723326a220b None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:43.009705 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069c8fcd-4086-4424-b513-30a470750ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:43.012998 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c8fcd-4086-4424-b513-30a470750ad4 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:43.015038 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c8fcd-4086-4424-b513-30a470750ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:43.016095 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c8fcd-4086-4424-b513-30a470750ad4 None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:43.019161 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069c8fcd-4086-4424-b513-30a470750ad4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:43.020762 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069c8fcd-4086-4424-b513-30a470750ad4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:43.024535 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069c8fcd-4086-4424-b513-30a470750ad4 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:43.028173 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146105e5-208c-420e-a95f-5ff28826399b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:43.032126 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146105e5-208c-420e-a95f-5ff28826399b None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:43.033476 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146105e5-208c-420e-a95f-5ff28826399b None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:43.034192 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146105e5-208c-420e-a95f-5ff28826399b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:43.036142 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146105e5-208c-420e-a95f-5ff28826399b None admin] RBAC: Adding query filter params (role.id=5e91422b372b43749fe857ffd7bba774, scope.project.id=52ebde8fa3f84ede9ef575f7c0780798, user.id=9afbb5a9f364495ca55089dd6ddd7934) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:43.038638 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146105e5-208c-420e-a95f-5ff28826399b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:43.043743 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146105e5-208c-420e-a95f-5ff28826399b None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:43.067098 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 361/753] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Sep 18 00:43:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:43.068636 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 393/754] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Sep 18 00:43:42 2022] GET /identity/v3/role_assignments?user.id=9afbb5a9f364495ca55089dd6ddd7934&scope.project.id=52ebde8fa3f84ede9ef575f7c0780798&role.id=5e91422b372b43749fe857ffd7bba774 => generated 259 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:43.073221 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069c8fcd-4086-4424-b513-30a470750ad4 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:43.204250 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:43.257171 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146105e5-208c-420e-a95f-5ff28826399b None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:43.284472 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069c8fcd-4086-4424-b513-30a470750ad4 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:43.409138 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dae825-6838-4c93-9b0f-0ff2abfaa512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:43.410161 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dae825-6838-4c93-9b0f-0ff2abfaa512 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:43.410644 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dae825-6838-4c93-9b0f-0ff2abfaa512 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:43.411118 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dae825-6838-4c93-9b0f-0ff2abfaa512 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:43.412533 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dae825-6838-4c93-9b0f-0ff2abfaa512 None admin] RBAC: Adding query filter params (role.id=591d4711dc204cf98003c8b7d7558506, scope.project.id=52ebde8fa3f84ede9ef575f7c0780798, user.id=d0f16f1f2cb8475d9d5c752f56c4b74d) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:43.413068 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dae825-6838-4c93-9b0f-0ff2abfaa512 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:43.414983 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dae825-6838-4c93-9b0f-0ff2abfaa512 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:43.427377 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 362/755] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Sep 18 00:43:43 2022] GET /identity/v3/role_assignments?user.id=d0f16f1f2cb8475d9d5c752f56c4b74d&scope.project.id=52ebde8fa3f84ede9ef575f7c0780798&role.id=591d4711dc204cf98003c8b7d7558506 => generated 259 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:43:43.585601 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146105e5-208c-420e-a95f-5ff28826399b None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:43.694251 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f049a92-6746-48c2-87c3-1ef20dd6c815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:43.695377 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f049a92-6746-48c2-87c3-1ef20dd6c815 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:43.695876 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f049a92-6746-48c2-87c3-1ef20dd6c815 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:43.696408 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f049a92-6746-48c2-87c3-1ef20dd6c815 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:43.719385 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f049a92-6746-48c2-87c3-1ef20dd6c815 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:43:43.730998 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-8f049a92-6746-48c2-87c3-1ef20dd6c815 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 00:43:43.730998 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:43.730998 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:43.730998 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:43.730998 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:43.730998 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:43.730998 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:43.730998 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:43.730998 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:43.730998 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:43.730998 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:43.730998 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:43.730998 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:43:43.730998 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:43:43.730998 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:43:43.730998 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:43:43.732827 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:43:43.732827 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:43:43.732827 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:43:43.732827 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:43:43.732827 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:43.732827 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:43.732827 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:43.732827 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:43.732827 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:43.732827 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:43.732827 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:43.732827 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:43.732827 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:43.732827 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:43.732827 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:43.732827 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:43.734408 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:43.734408 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:43.734408 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:43.734408 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:43.734408 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:43:43.734408 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:43:43.734408 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:43:43.734408 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:43:43.734408 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:43:43.734408 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:43:43.734408 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 00:43:43.734408 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:43.734408 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 394/756] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Sep 18 00:43:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 477 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:43.744068 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dae825-6838-4c93-9b0f-0ff2abfaa512 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:43.962753 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dae825-6838-4c93-9b0f-0ff2abfaa512 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:44.047325 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb4ee1-78bd-4739-89cb-85fe3f9a0946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:44.048304 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb4ee1-78bd-4739-89cb-85fe3f9a0946 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:44.049345 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb4ee1-78bd-4739-89cb-85fe3f9a0946 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:44.049853 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb4ee1-78bd-4739-89cb-85fe3f9a0946 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:44.051111 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb4ee1-78bd-4739-89cb-85fe3f9a0946 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:44.051641 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb4ee1-78bd-4739-89cb-85fe3f9a0946 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:44.054326 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb4ee1-78bd-4739-89cb-85fe3f9a0946 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:44.057227 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:44.073546 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 363/757] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Sep 18 00:43:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:44.083679 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f049a92-6746-48c2-87c3-1ef20dd6c815 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:44.126144 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:44.289144 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f049a92-6746-48c2-87c3-1ef20dd6c815 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:44.363220 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17e8c2a-0832-4441-be37-8e9773d76e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:44.364289 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e8c2a-0832-4441-be37-8e9773d76e6e None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:44.364796 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e8c2a-0832-4441-be37-8e9773d76e6e None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:44.365279 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e8c2a-0832-4441-be37-8e9773d76e6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:44.388014 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17e8c2a-0832-4441-be37-8e9773d76e6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:44.390603 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17e8c2a-0832-4441-be37-8e9773d76e6e None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:44.424450 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-f17e8c2a-0832-4441-be37-8e9773d76e6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:44.424450 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:44.424450 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:44.424450 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:44.424450 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:44.424450 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:44.424450 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:44.424450 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:44.424450 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:44.424450 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:44.424450 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:44.424450 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:44.424450 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:43:44.424450 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:43:44.424450 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:43:44.424450 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:43:44.425436 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:44.425436 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:44.425436 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:44.425436 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:44.425436 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:44.425436 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:44.425436 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:44.425436 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:44.425436 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:44.425436 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:44.425436 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:44.425436 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:44.425436 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:44.425436 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:44.425436 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:44.425436 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:44.425436 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:43:44.426320 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:43:44.426320 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:44.426320 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:44.429894 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 395/758] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:43:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:44.439569 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb4ee1-78bd-4739-89cb-85fe3f9a0946 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:44.650899 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb4ee1-78bd-4739-89cb-85fe3f9a0946 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:44.705830 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de83cff0-8bb8-4523-a104-93c400c041dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:44.706462 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83cff0-8bb8-4523-a104-93c400c041dc None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:44.706746 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83cff0-8bb8-4523-a104-93c400c041dc None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:44.707071 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83cff0-8bb8-4523-a104-93c400c041dc None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:44.707680 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de83cff0-8bb8-4523-a104-93c400c041dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:44.708015 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de83cff0-8bb8-4523-a104-93c400c041dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:44.709431 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de83cff0-8bb8-4523-a104-93c400c041dc None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:44.727559 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 364/759] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:43:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:44.736888 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17e8c2a-0832-4441-be37-8e9773d76e6e None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:44.871326 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:44.919001 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17e8c2a-0832-4441-be37-8e9773d76e6e None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:44.978181 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13317950-4867-46cf-93ad-b5c698b65591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:44.979151 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13317950-4867-46cf-93ad-b5c698b65591 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:44.979647 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13317950-4867-46cf-93ad-b5c698b65591 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:44.980132 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13317950-4867-46cf-93ad-b5c698b65591 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:44.990565 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13317950-4867-46cf-93ad-b5c698b65591 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:44.992468 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13317950-4867-46cf-93ad-b5c698b65591 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:45.014316 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-13317950-4867-46cf-93ad-b5c698b65591 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 18 00:43:45.014316 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:45.014316 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:45.014316 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:45.014316 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:45.014316 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:45.014316 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:45.014316 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:45.014316 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:45.014316 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:45.014316 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:45.014316 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:45.014316 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 00:43:45.014316 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 00:43:45.014316 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 00:43:45.014316 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 00:43:45.015337 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:45.015337 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:45.015337 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 00:43:45.015337 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:43:45.015337 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 00:43:45.015337 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:43:45.015337 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:45.015337 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:45.015337 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:45.015337 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:45.015337 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:45.015337 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:45.015337 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:45.015337 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:45.015337 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:45.015337 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:45.015337 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:45.015337 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:45.016333 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:45.016333 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:45.016333 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 00:43:45.016333 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 00:43:45.016333 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 00:43:45.016333 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 00:43:45.016333 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 00:43:45.016333 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 00:43:45.016333 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 18 00:43:45.016333 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:45.018781 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 396/760] 10.222.0.15 () {56 vars in 1093 bytes} [Sun Sep 18 00:43:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:45.029092 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de83cff0-8bb8-4523-a104-93c400c041dc None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:45.145034 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:45.215567 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de83cff0-8bb8-4523-a104-93c400c041dc None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:45.278080 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f78a101-4a35-4073-8cc0-b830e5c54599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:45.279088 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78a101-4a35-4073-8cc0-b830e5c54599 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:45.279581 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78a101-4a35-4073-8cc0-b830e5c54599 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:45.280096 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78a101-4a35-4073-8cc0-b830e5c54599 None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:45.281434 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f78a101-4a35-4073-8cc0-b830e5c54599 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:45.281985 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f78a101-4a35-4073-8cc0-b830e5c54599 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:45.284771 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f78a101-4a35-4073-8cc0-b830e5c54599 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:45.316730 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 365/761] 10.222.0.15 () {56 vars in 1133 bytes} [Sun Sep 18 00:43:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:45.328049 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13317950-4867-46cf-93ad-b5c698b65591 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:45.363362 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a5225-9cd1-43a9-b2f1-2dbb4436986a None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:45.363700 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a5225-9cd1-43a9-b2f1-2dbb4436986a None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:45.363957 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a5225-9cd1-43a9-b2f1-2dbb4436986a None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:45.365604 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 366/762] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:43:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:43:45.372714 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e48adb-860f-42fa-9cd2-a1a225cbf681 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:45.373067 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e48adb-860f-42fa-9cd2-a1a225cbf681 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:45.373346 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e48adb-860f-42fa-9cd2-a1a225cbf681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:45.396304 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-22e48adb-860f-42fa-9cd2-a1a225cbf681 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:43:45.398425 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-22e48adb-860f-42fa-9cd2-a1a225cbf681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:43:45.608052 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 367/763] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:43:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 18 00:43:45.632573 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13317950-4867-46cf-93ad-b5c698b65591 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:45.669855 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973e2ae-7930-4bee-b76b-d29fc952b9b7 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:45.670311 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973e2ae-7930-4bee-b76b-d29fc952b9b7 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:45.670795 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973e2ae-7930-4bee-b76b-d29fc952b9b7 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:45.673615 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 368/764] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:43:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:43:45.682461 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41663db-d6b7-4f42-9d56-09a719af6f51 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:45.682970 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41663db-d6b7-4f42-9d56-09a719af6f51 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:45.683551 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41663db-d6b7-4f42-9d56-09a719af6f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:45.703811 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:45.718813 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dde0b3-5b9c-4794-91fd-a9388a4299c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:45.719917 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dde0b3-5b9c-4794-91fd-a9388a4299c4 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:45.720457 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dde0b3-5b9c-4794-91fd-a9388a4299c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:45.720945 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dde0b3-5b9c-4794-91fd-a9388a4299c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:45.752721 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dde0b3-5b9c-4794-91fd-a9388a4299c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:45.755140 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dde0b3-5b9c-4794-91fd-a9388a4299c4 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:45.755675 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-f41663db-d6b7-4f42-9d56-09a719af6f51 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:43:45.757905 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-f41663db-d6b7-4f42-9d56-09a719af6f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:43:45.783328 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-68dde0b3-5b9c-4794-91fd-a9388a4299c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:45.783328 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:45.783328 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:45.783328 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:45.783328 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:45.783328 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:45.783328 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:45.783328 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:45.783328 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:45.783328 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:45.783328 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:45.783328 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:45.783328 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:43:45.783328 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:43:45.783328 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:43:45.783328 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:43:45.785224 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:45.785224 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:45.785224 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:45.785224 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:45.785224 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:45.785224 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:45.785224 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:45.785224 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:45.785224 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:45.785224 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:45.785224 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:45.785224 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:45.785224 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:45.785224 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:45.785224 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:45.785224 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:45.785224 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:43:45.786927 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:43:45.786927 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:45.786927 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:45.786927 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 397/765] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:43:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 459 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:45.800031 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dde0b3-5b9c-4794-91fd-a9388a4299c4 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:45.894701 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:45.943935 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 369/766] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:43:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 18 00:43:46.089710 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dde0b3-5b9c-4794-91fd-a9388a4299c4 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:46.119287 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41663db-d6b7-4f42-9d56-09a719af6f51 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:46.202668 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e68dfb-d481-4652-b7ae-45c0806b8ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:46.203737 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e68dfb-d481-4652-b7ae-45c0806b8ad3 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:46.204270 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e68dfb-d481-4652-b7ae-45c0806b8ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:46.204812 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e68dfb-d481-4652-b7ae-45c0806b8ad3 None admin] PATH_INFO: `/v3/domains` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:46.206112 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e68dfb-d481-4652-b7ae-45c0806b8ad3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:46.206655 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e68dfb-d481-4652-b7ae-45c0806b8ad3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:46.212932 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e68dfb-d481-4652-b7ae-45c0806b8ad3 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:46.257962 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 398/767] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:43:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 461 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:43:46.271992 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e68dfb-d481-4652-b7ae-45c0806b8ad3 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:46.406457 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:46.476708 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41663db-d6b7-4f42-9d56-09a719af6f51 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:46.511227 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e68dfb-d481-4652-b7ae-45c0806b8ad3 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:46.533552 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a104d-b945-49d9-893d-6c0eb795c00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:46.534502 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a104d-b945-49d9-893d-6c0eb795c00e None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:46.534767 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a104d-b945-49d9-893d-6c0eb795c00e None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:46.535048 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a104d-b945-49d9-893d-6c0eb795c00e None admin] PATH_INFO: `/v3/services/network` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:46.536129 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93a104d-b945-49d9-893d-6c0eb795c00e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:46.538115 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93a104d-b945-49d9-893d-6c0eb795c00e None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:46.553996 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-f93a104d-b945-49d9-893d-6c0eb795c00e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 18 00:43:46.553996 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:46.553996 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 18 00:43:46.553996 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 18 00:43:46.553996 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 18 00:43:46.553996 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 18 00:43:46.553996 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 18 00:43:46.553996 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 00:43:46.553996 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 18 00:43:46.553996 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:46.553996 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 18 00:43:46.553996 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:46.553996 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:46.553996 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:46.553996 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:46.553996 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:46.553996 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:46.555040 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:46.555040 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:46.555040 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:46.555040 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:46.555040 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:46.555040 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:46.555040 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 18 00:43:46.555040 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 18 00:43:46.555040 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 18 00:43:46.555040 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 18 00:43:46.555040 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:46.555040 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:46.555040 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:46.555040 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:46.555040 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:46.555040 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:46.555860 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:46.555860 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:46.555860 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:46.555860 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:46.555860 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:46.555860 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:46.555860 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:46.555860 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:46.555860 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:46.555860 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:46.555860 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 18 00:43:46.555860 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 00:43:46.555860 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 18 00:43:46.555860 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:46.563933 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 370/768] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Sep 18 00:43:46 2022] GET /identity/v3/services/network => generated 88 bytes in 440 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:46.563933 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a104d-b945-49d9-893d-6c0eb795c00e None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:46.570753 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b621c-48c2-453d-b1e1-3e4f4b056352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:46.571936 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b621c-48c2-453d-b1e1-3e4f4b056352 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:46.572472 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b621c-48c2-453d-b1e1-3e4f4b056352 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:46.572913 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b621c-48c2-453d-b1e1-3e4f4b056352 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:46.586691 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6b621c-48c2-453d-b1e1-3e4f4b056352 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:46.589512 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6b621c-48c2-453d-b1e1-3e4f4b056352 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:46.616041 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-fd6b621c-48c2-453d-b1e1-3e4f4b056352 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:43:46.616041 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:46.616041 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:46.616041 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:46.616041 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:46.616041 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:46.616041 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:46.616041 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:46.616041 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:46.616041 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:46.616041 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:46.616041 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:46.616041 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 00:43:46.616041 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 00:43:46.616041 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 00:43:46.616993 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 00:43:46.616993 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:46.616993 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:46.616993 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:46.616993 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:46.616993 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:46.616993 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:46.616993 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:46.616993 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:46.616993 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:46.616993 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:46.616993 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:46.616993 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:46.616993 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:46.616993 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:46.616993 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:46.616993 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:46.617861 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 00:43:46.617861 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 00:43:46.617861 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 00:43:46.617861 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 00:43:46.617861 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 00:43:46.617861 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 00:43:46.617861 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:43:46.617861 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:46.621088 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:46.624335 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 399/769] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Sep 18 00:43:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 00:43:46.625967 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b621c-48c2-453d-b1e1-3e4f4b056352 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:46.710077 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a104d-b945-49d9-893d-6c0eb795c00e None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:46.749737 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5ccb83-744a-47cc-af1b-e061bd2c7ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:46.750775 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ccb83-744a-47cc-af1b-e061bd2c7ba1 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:46.751214 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ccb83-744a-47cc-af1b-e061bd2c7ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:46.752216 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ccb83-744a-47cc-af1b-e061bd2c7ba1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:46.752983 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5ccb83-744a-47cc-af1b-e061bd2c7ba1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:46.754586 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5ccb83-744a-47cc-af1b-e061bd2c7ba1 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:46.765212 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-fa5ccb83-744a-47cc-af1b-e061bd2c7ba1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 18 00:43:46.765212 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:46.765212 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 18 00:43:46.765212 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 18 00:43:46.765212 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 18 00:43:46.765212 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 18 00:43:46.765212 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 18 00:43:46.765212 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 00:43:46.765212 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 18 00:43:46.765212 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:46.765212 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 18 00:43:46.765212 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:46.765212 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:46.765212 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:46.765212 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:46.765212 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:46.765212 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:46.766501 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:46.766501 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:46.766501 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:46.766501 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:46.766501 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:46.766501 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:46.766501 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 18 00:43:46.766501 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 18 00:43:46.766501 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 18 00:43:46.766501 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 18 00:43:46.766501 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:46.766501 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:46.766501 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:46.766501 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:46.766501 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:46.766501 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:46.767538 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:46.767538 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:46.767538 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:46.767538 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:46.767538 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:46.767538 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:46.767538 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:46.767538 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:46.767538 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:46.767538 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:46.767538 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 18 00:43:46.767538 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 00:43:46.767538 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 18 00:43:46.767538 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:46.770369 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 371/770] 10.222.0.15 () {56 vars in 1129 bytes} [Sun Sep 18 00:43:46 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:46.771489 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5ccb83-744a-47cc-af1b-e061bd2c7ba1 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:46.837116 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b621c-48c2-453d-b1e1-3e4f4b056352 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:46.841356 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:46.895002 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5ccb83-744a-47cc-af1b-e061bd2c7ba1 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:46.897149 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:46.906718 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71512883-43ce-4796-8a91-1e3dd7257e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:46.908235 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71512883-43ce-4796-8a91-1e3dd7257e09 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:46.908796 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71512883-43ce-4796-8a91-1e3dd7257e09 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:46.909408 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71512883-43ce-4796-8a91-1e3dd7257e09 None admin] PATH_INFO: `/v3/services` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:46.910631 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71512883-43ce-4796-8a91-1e3dd7257e09 None admin] RBAC: Adding query filter params (name=network) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:46.911206 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71512883-43ce-4796-8a91-1e3dd7257e09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:46.913976 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71512883-43ce-4796-8a91-1e3dd7257e09 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:46.927845 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 400/771] 10.222.0.15 () {56 vars in 1112 bytes} [Sun Sep 18 00:43:46 2022] GET /identity/v3/services?name=network => generated 124 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:46.927845 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71512883-43ce-4796-8a91-1e3dd7257e09 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:46.935471 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd1baf5-1ab1-48f9-a0b6-a2243b43b85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:46.936126 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1baf5-1ab1-48f9-a0b6-a2243b43b85a None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:46.936411 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1baf5-1ab1-48f9-a0b6-a2243b43b85a None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:46.936688 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1baf5-1ab1-48f9-a0b6-a2243b43b85a None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:46.937389 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd1baf5-1ab1-48f9-a0b6-a2243b43b85a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:46.937698 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd1baf5-1ab1-48f9-a0b6-a2243b43b85a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:46.939249 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd1baf5-1ab1-48f9-a0b6-a2243b43b85a None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:46.953941 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 372/772] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Sep 18 00:43:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:46.955775 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da1067-2bc7-47c3-b9c2-d398c77dc7ec None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:46.956098 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da1067-2bc7-47c3-b9c2-d398c77dc7ec None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:46.956376 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da1067-2bc7-47c3-b9c2-d398c77dc7ec None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:46.961789 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 373/773] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:43:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:43:46.961789 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56da1067-2bc7-47c3-b9c2-d398c77dc7ec None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:47.076333 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71512883-43ce-4796-8a91-1e3dd7257e09 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:47.082231 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56da1067-2bc7-47c3-b9c2-d398c77dc7ec None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:47.130799 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841c8683-1e68-43e5-8db2-5274f8564d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:47.131769 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c8683-1e68-43e5-8db2-5274f8564d3d None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:47.132290 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c8683-1e68-43e5-8db2-5274f8564d3d None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:47.132760 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c8683-1e68-43e5-8db2-5274f8564d3d None admin] PATH_INFO: `/v3/services` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:47.133854 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841c8683-1e68-43e5-8db2-5274f8564d3d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:47.134341 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841c8683-1e68-43e5-8db2-5274f8564d3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:47.136429 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf81a36-26b6-481b-8236-616e39948ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:47.136891 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841c8683-1e68-43e5-8db2-5274f8564d3d None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:47.137376 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf81a36-26b6-481b-8236-616e39948ea5 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:47.137819 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf81a36-26b6-481b-8236-616e39948ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:47.138254 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf81a36-26b6-481b-8236-616e39948ea5 None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:47.139286 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf81a36-26b6-481b-8236-616e39948ea5 None admin] RBAC: Adding query filter params (type=network) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:47.140096 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf81a36-26b6-481b-8236-616e39948ea5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:47.141908 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf81a36-26b6-481b-8236-616e39948ea5 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:47.150041 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 401/774] 10.222.0.15 () {56 vars in 1124 bytes} [Sun Sep 18 00:43:46 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:47.150041 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bf4e4-4718-482a-bb02-5c171e2e92d3 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:47.150041 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bf4e4-4718-482a-bb02-5c171e2e92d3 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:47.150041 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bf4e4-4718-482a-bb02-5c171e2e92d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:47.157333 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 374/775] 10.222.0.15 () {56 vars in 1112 bytes} [Sun Sep 18 00:43:46 2022] GET /identity/v3/services?type=network => generated 350 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:47.158146 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf81a36-26b6-481b-8236-616e39948ea5 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:47.180713 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-394bf4e4-4718-482a-bb02-5c171e2e92d3 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:43:47.182455 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-394bf4e4-4718-482a-bb02-5c171e2e92d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:43:47.196739 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:47.223278 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:47.275736 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 402/776] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:43:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 00:43:47.276511 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394bf4e4-4718-482a-bb02-5c171e2e92d3 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:47.311108 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf81a36-26b6-481b-8236-616e39948ea5 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:47.374838 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d9be3-2488-41f4-b3dd-ce8b886bd448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:47.375650 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d9be3-2488-41f4-b3dd-ce8b886bd448 None admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:47.375968 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d9be3-2488-41f4-b3dd-ce8b886bd448 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:47.376238 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d9be3-2488-41f4-b3dd-ce8b886bd448 None admin] PATH_INFO: `/v3/projects/52ebde8fa3f84ede9ef575f7c0780798/users/264c183fff8a49478eea4aceea73273e/roles/591d4711dc204cf98003c8b7d7558506` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:47.378842 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9d9be3-2488-41f4-b3dd-ce8b886bd448 None admin] RBAC: Authorizing `identity:create_grant(project_id=52ebde8fa3f84ede9ef575f7c0780798, user_id=264c183fff8a49478eea4aceea73273e, role_id=591d4711dc204cf98003c8b7d7558506)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:47.380375 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9d9be3-2488-41f4-b3dd-ce8b886bd448 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:47.397610 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 375/777] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Sep 18 00:43:47 2022] PUT /identity/v3/projects/52ebde8fa3f84ede9ef575f7c0780798/users/264c183fff8a49478eea4aceea73273e/roles/591d4711dc204cf98003c8b7d7558506 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 00:43:47.398165 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d9be3-2488-41f4-b3dd-ce8b886bd448 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:47.440071 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394bf4e4-4718-482a-bb02-5c171e2e92d3 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:47.527138 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:47.548098 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d9be3-2488-41f4-b3dd-ce8b886bd448 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:47.558274 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77159307-6dfb-47a3-960f-0a59d110f820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:47.560701 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77159307-6dfb-47a3-960f-0a59d110f820 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:47.561505 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77159307-6dfb-47a3-960f-0a59d110f820 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:47.562195 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77159307-6dfb-47a3-960f-0a59d110f820 None admin] PATH_INFO: `/v3/services` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:47.565137 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77159307-6dfb-47a3-960f-0a59d110f820 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:47.566613 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77159307-6dfb-47a3-960f-0a59d110f820 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:47.571218 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77159307-6dfb-47a3-960f-0a59d110f820 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:47.591926 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 403/778] 10.222.0.15 () {56 vars in 1124 bytes} [Sun Sep 18 00:43:47 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:47.591926 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f1fe7-0b35-4c37-91fe-ad76f2d3d39d None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:47.591926 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f1fe7-0b35-4c37-91fe-ad76f2d3d39d None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:47.591926 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f1fe7-0b35-4c37-91fe-ad76f2d3d39d None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:47.591926 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 404/779] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:43:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:43:47.596497 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f1fe7-0b35-4c37-91fe-ad76f2d3d39d None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:47.609643 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adbfab4-2192-4756-95a9-b0122e942c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:47.610294 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbfab4-2192-4756-95a9-b0122e942c96 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:47.610580 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbfab4-2192-4756-95a9-b0122e942c96 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:47.611446 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbfab4-2192-4756-95a9-b0122e942c96 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:47.612330 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adbfab4-2192-4756-95a9-b0122e942c96 None admin] RBAC: Adding query filter params (interface=public, service_id=f40a8a0b36ac48bcb5b096fd481218a1, region_id=RegionOne) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:47.612707 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adbfab4-2192-4756-95a9-b0122e942c96 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:47.614171 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adbfab4-2192-4756-95a9-b0122e942c96 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:47.624097 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 376/780] 10.222.0.15 () {56 vars in 1251 bytes} [Sun Sep 18 00:43:47 2022] GET /identity/v3/endpoints?service_id=f40a8a0b36ac48bcb5b096fd481218a1&interface=public®ion_id=RegionOne => generated 194 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:47.624911 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cae1c2-8b79-490a-bc02-b9cfdd2234b5 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:47.625195 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cae1c2-8b79-490a-bc02-b9cfdd2234b5 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:47.625478 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cae1c2-8b79-490a-bc02-b9cfdd2234b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:47.647120 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-31cae1c2-8b79-490a-bc02-b9cfdd2234b5 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:43:47.648438 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-31cae1c2-8b79-490a-bc02-b9cfdd2234b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:43:47.665784 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:47.742397 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 377/781] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:43:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 00:43:47.743615 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cae1c2-8b79-490a-bc02-b9cfdd2234b5 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:47.771137 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f1fe7-0b35-4c37-91fe-ad76f2d3d39d None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:47.843016 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e889fc-433d-4684-a64a-1ebc9b92ecb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:47.844015 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e889fc-433d-4684-a64a-1ebc9b92ecb0 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:47.847926 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e889fc-433d-4684-a64a-1ebc9b92ecb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:47.847926 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e889fc-433d-4684-a64a-1ebc9b92ecb0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:47.847926 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e889fc-433d-4684-a64a-1ebc9b92ecb0 None admin] RBAC: Adding query filter params (interface=public, service_id=fb22fd04540d42ff973655a2120ecb17, region_id=RegionOne) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:47.847926 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e889fc-433d-4684-a64a-1ebc9b92ecb0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:47.850475 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e889fc-433d-4684-a64a-1ebc9b92ecb0 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:47.865297 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:47.872121 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 405/782] 10.222.0.15 () {56 vars in 1251 bytes} [Sun Sep 18 00:43:47 2022] GET /identity/v3/endpoints?service_id=fb22fd04540d42ff973655a2120ecb17&interface=public®ion_id=RegionOne => generated 194 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:43:47.877457 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e889fc-433d-4684-a64a-1ebc9b92ecb0 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:47.890257 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cae1c2-8b79-490a-bc02-b9cfdd2234b5 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:47.930561 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e77ad-bbc7-4dcd-9707-324114fcfea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:47.931262 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e77ad-bbc7-4dcd-9707-324114fcfea7 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:47.931599 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e77ad-bbc7-4dcd-9707-324114fcfea7 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:47.931882 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e77ad-bbc7-4dcd-9707-324114fcfea7 None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:47.932546 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e77ad-bbc7-4dcd-9707-324114fcfea7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:47.934118 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e77ad-bbc7-4dcd-9707-324114fcfea7 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:47.941053 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 378/783] 10.222.0.15 () {56 vars in 1087 bytes} [Sun Sep 18 00:43:47 2022] GET /identity/v3/services => generated 772 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:47.942030 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e77ad-bbc7-4dcd-9707-324114fcfea7 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:48.067209 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:48.091499 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e889fc-433d-4684-a64a-1ebc9b92ecb0 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:48.182797 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e77ad-bbc7-4dcd-9707-324114fcfea7 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:48.184148 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d8ee5a-2a8a-4ea8-ac50-9bbac9a0f07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:48.185239 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8ee5a-2a8a-4ea8-ac50-9bbac9a0f07d None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:48.185722 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8ee5a-2a8a-4ea8-ac50-9bbac9a0f07d None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:48.186211 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8ee5a-2a8a-4ea8-ac50-9bbac9a0f07d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:48.209391 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d8ee5a-2a8a-4ea8-ac50-9bbac9a0f07d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:43:48.221109 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-55d8ee5a-2a8a-4ea8-ac50-9bbac9a0f07d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 00:43:48.221109 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:48.221109 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:48.221109 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:48.221109 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:48.221109 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:48.221109 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:48.221109 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:48.221109 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:48.221109 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:48.221109 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:48.221109 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:48.221109 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:43:48.221109 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:43:48.221109 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:43:48.221109 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:43:48.224626 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:43:48.224626 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:43:48.224626 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:43:48.224626 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:43:48.224626 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:48.224626 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:48.224626 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:48.224626 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:48.224626 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:48.224626 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:48.224626 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:48.224626 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:48.224626 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:48.224626 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:48.224626 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:48.224626 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:48.228508 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:48.228508 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:48.228508 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:48.228508 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:48.228508 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:43:48.228508 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:43:48.228508 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:43:48.228508 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:43:48.228508 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:43:48.228508 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:43:48.228508 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 00:43:48.228508 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:48.228508 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 406/784] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Sep 18 00:43:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:48.228508 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d8ee5a-2a8a-4ea8-ac50-9bbac9a0f07d None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:48.237281 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43daecb-e3b7-4b07-b9f4-6fb41e815eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:48.237281 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43daecb-e3b7-4b07-b9f4-6fb41e815eb7 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:48.237281 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43daecb-e3b7-4b07-b9f4-6fb41e815eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:48.237281 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43daecb-e3b7-4b07-b9f4-6fb41e815eb7 None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:48.237847 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43daecb-e3b7-4b07-b9f4-6fb41e815eb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:48.237847 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43daecb-e3b7-4b07-b9f4-6fb41e815eb7 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:48.242349 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 379/785] 10.222.0.15 () {56 vars in 1087 bytes} [Sun Sep 18 00:43:47 2022] GET /identity/v3/services => generated 772 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:48.242349 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43daecb-e3b7-4b07-b9f4-6fb41e815eb7 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:48.260531 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:48.477655 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43daecb-e3b7-4b07-b9f4-6fb41e815eb7 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:48.478837 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d8ee5a-2a8a-4ea8-ac50-9bbac9a0f07d None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:48.551041 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e27cf1-a1f0-478b-992d-1f46c1451c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:48.552784 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e27cf1-a1f0-478b-992d-1f46c1451c32 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:48.553585 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e27cf1-a1f0-478b-992d-1f46c1451c32 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:48.554351 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e27cf1-a1f0-478b-992d-1f46c1451c32 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:48.556010 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e27cf1-a1f0-478b-992d-1f46c1451c32 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:48.556866 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e27cf1-a1f0-478b-992d-1f46c1451c32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:48.559774 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e27cf1-a1f0-478b-992d-1f46c1451c32 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:48.577851 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 380/786] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Sep 18 00:43:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:48.585466 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638595b-ea09-4e07-8a89-ec1a108924df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:48.586435 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e27cf1-a1f0-478b-992d-1f46c1451c32 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:48.586603 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638595b-ea09-4e07-8a89-ec1a108924df None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:48.586926 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638595b-ea09-4e07-8a89-ec1a108924df None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:48.587396 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638595b-ea09-4e07-8a89-ec1a108924df None admin] PATH_INFO: `/v3/roles/service` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:48.609078 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e638595b-ea09-4e07-8a89-ec1a108924df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:43:48.618647 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-e638595b-ea09-4e07-8a89-ec1a108924df None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 18 00:43:48.618647 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:48.618647 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:48.618647 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:48.618647 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:48.618647 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:48.618647 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:48.618647 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:48.618647 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:48.618647 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:48.618647 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:48.618647 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:48.618647 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:43:48.618647 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:43:48.618647 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:43:48.618647 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:43:48.620593 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:43:48.620593 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:43:48.620593 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:43:48.620593 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:43:48.620593 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:48.620593 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:48.620593 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:48.620593 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:48.620593 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:48.620593 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:48.620593 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:48.620593 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:48.620593 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:48.620593 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:48.620593 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:48.620593 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:48.621803 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:48.621803 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:48.621803 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:48.621803 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:48.621803 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:43:48.621803 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:43:48.621803 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:43:48.621803 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:43:48.621803 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:43:48.621803 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:43:48.621803 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 18 00:43:48.621803 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:48.621803 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 407/787] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Sep 18 00:43:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 397 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:48.631882 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638595b-ea09-4e07-8a89-ec1a108924df None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:48.659953 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:48.746167 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:48.823961 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e27cf1-a1f0-478b-992d-1f46c1451c32 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:48.892923 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc5f7cb-1023-4774-86f1-5b86ca97b337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:48.893986 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5f7cb-1023-4774-86f1-5b86ca97b337 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:48.894472 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5f7cb-1023-4774-86f1-5b86ca97b337 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:48.895524 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5f7cb-1023-4774-86f1-5b86ca97b337 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:48.918822 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc5f7cb-1023-4774-86f1-5b86ca97b337 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:48.921546 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc5f7cb-1023-4774-86f1-5b86ca97b337 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:48.955589 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-dfc5f7cb-1023-4774-86f1-5b86ca97b337 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:48.955589 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:48.955589 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:48.955589 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:48.955589 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:48.955589 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:48.955589 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:48.955589 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:48.955589 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:48.955589 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:48.955589 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:48.955589 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:48.955589 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:43:48.955589 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:43:48.955589 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:43:48.955589 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:43:48.957498 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:48.957498 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:48.957498 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:48.957498 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:48.957498 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:48.957498 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:48.957498 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:48.957498 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:48.957498 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:48.957498 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:48.957498 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:48.957498 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:48.957498 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:48.957498 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:48.957498 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:48.957498 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:48.957498 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:43:48.959016 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:43:48.959016 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:48.959016 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:48.959016 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 381/788] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:43:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:48.969588 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc5f7cb-1023-4774-86f1-5b86ca97b337 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:48.973929 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638595b-ea09-4e07-8a89-ec1a108924df None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:49.100893 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbaa88d-6b84-4793-b845-7f23ba7a4daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:49.101445 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbaa88d-6b84-4793-b845-7f23ba7a4daa None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:49.101732 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbaa88d-6b84-4793-b845-7f23ba7a4daa None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:49.102034 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbaa88d-6b84-4793-b845-7f23ba7a4daa None admin] PATH_INFO: `/v3/roles` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:49.102724 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbaa88d-6b84-4793-b845-7f23ba7a4daa None admin] RBAC: Adding query filter params (name=service) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:49.103034 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbaa88d-6b84-4793-b845-7f23ba7a4daa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:49.104512 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbaa88d-6b84-4793-b845-7f23ba7a4daa None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:49.128952 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 408/789] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Sep 18 00:43:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 498 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:49.140007 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbaa88d-6b84-4793-b845-7f23ba7a4daa None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:49.209183 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc5f7cb-1023-4774-86f1-5b86ca97b337 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:49.266623 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:49.293776 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d0cdd1-0caa-4063-b5bd-3fa92640b8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:49.294424 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d0cdd1-0caa-4063-b5bd-3fa92640b8a9 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:49.294710 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d0cdd1-0caa-4063-b5bd-3fa92640b8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:49.294988 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d0cdd1-0caa-4063-b5bd-3fa92640b8a9 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:49.295653 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d0cdd1-0caa-4063-b5bd-3fa92640b8a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:49.295987 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d0cdd1-0caa-4063-b5bd-3fa92640b8a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:49.297405 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d0cdd1-0caa-4063-b5bd-3fa92640b8a9 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:49.318165 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 382/790] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:43:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:49.325525 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:49.329310 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d0cdd1-0caa-4063-b5bd-3fa92640b8a9 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:49.396609 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbaa88d-6b84-4793-b845-7f23ba7a4daa None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:49.466666 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4e3fef-1c08-4ddf-96ed-ea8340d5d9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:49.468324 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e3fef-1c08-4ddf-96ed-ea8340d5d9cc None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:49.469381 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e3fef-1c08-4ddf-96ed-ea8340d5d9cc None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:49.470723 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e3fef-1c08-4ddf-96ed-ea8340d5d9cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:49.520348 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4e3fef-1c08-4ddf-96ed-ea8340d5d9cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:49.523807 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4e3fef-1c08-4ddf-96ed-ea8340d5d9cc None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:49.567323 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-6c4e3fef-1c08-4ddf-96ed-ea8340d5d9cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:49.567323 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:49.567323 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:49.567323 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:49.567323 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:49.567323 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:49.567323 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:49.567323 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:49.567323 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:49.567323 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:49.567323 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:49.567323 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:49.567323 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:43:49.567323 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:43:49.567323 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:43:49.567323 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:43:49.569253 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:49.569253 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:49.569253 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:49.569253 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:49.569253 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:49.569253 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:49.569253 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:49.569253 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:49.569253 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:49.569253 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:49.569253 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:49.569253 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:49.569253 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:49.569253 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:49.569253 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:49.569253 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:49.569253 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:43:49.571027 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:43:49.571027 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:49.571027 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:49.574752 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 409/791] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:43:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 438 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 00:43:49.586837 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4e3fef-1c08-4ddf-96ed-ea8340d5d9cc None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:49.629413 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d0cdd1-0caa-4063-b5bd-3fa92640b8a9 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:49.805821 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4e3fef-1c08-4ddf-96ed-ea8340d5d9cc None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:49.856246 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:49.882147 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc40f571-349f-46a8-a69f-16d4b7d9633e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:49.884075 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc40f571-349f-46a8-a69f-16d4b7d9633e None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:49.884878 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc40f571-349f-46a8-a69f-16d4b7d9633e None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:49.885675 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc40f571-349f-46a8-a69f-16d4b7d9633e None admin] PATH_INFO: `/v3/domains` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:49.887135 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc40f571-349f-46a8-a69f-16d4b7d9633e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:49.888214 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc40f571-349f-46a8-a69f-16d4b7d9633e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:49.891079 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc40f571-349f-46a8-a69f-16d4b7d9633e None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:49.907307 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b153eb-cbb7-424f-90ae-e722b5343c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:49.908118 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b153eb-cbb7-424f-90ae-e722b5343c79 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:49.908413 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b153eb-cbb7-424f-90ae-e722b5343c79 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:49.908706 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b153eb-cbb7-424f-90ae-e722b5343c79 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:49.917800 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b153eb-cbb7-424f-90ae-e722b5343c79 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:49.919295 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b153eb-cbb7-424f-90ae-e722b5343c79 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:49.922797 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 410/792] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:43:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:43:49.932178 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc40f571-349f-46a8-a69f-16d4b7d9633e None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:49.957982 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-29b153eb-cbb7-424f-90ae-e722b5343c79 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 18 00:43:49.957982 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:49.957982 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:49.957982 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:49.957982 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:49.957982 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:49.957982 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:49.957982 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:49.957982 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:49.957982 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:49.957982 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:49.957982 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:49.957982 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 00:43:49.957982 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 00:43:49.957982 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 00:43:49.957982 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 00:43:49.959781 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:49.959781 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:49.959781 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 00:43:49.959781 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:43:49.959781 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 00:43:49.959781 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:43:49.959781 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:49.959781 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:49.959781 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:49.959781 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:49.959781 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:49.959781 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:49.959781 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:49.959781 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:49.959781 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:49.959781 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:49.959781 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:49.959781 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:49.961660 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:49.961660 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:49.961660 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 00:43:49.961660 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 00:43:49.961660 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 00:43:49.961660 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 00:43:49.961660 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 00:43:49.961660 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 00:43:49.961660 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 18 00:43:49.961660 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:49.963103 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 383/793] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Sep 18 00:43:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 634 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:49.966100 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b153eb-cbb7-424f-90ae-e722b5343c79 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:50.075966 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:50.197989 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b153eb-cbb7-424f-90ae-e722b5343c79 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:50.300699 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a481e-7384-4b07-960e-dd262d51bf5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:50.301697 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a481e-7384-4b07-960e-dd262d51bf5a None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:50.301697 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a481e-7384-4b07-960e-dd262d51bf5a None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:50.301986 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a481e-7384-4b07-960e-dd262d51bf5a None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:50.302606 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3a481e-7384-4b07-960e-dd262d51bf5a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:50.302913 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3a481e-7384-4b07-960e-dd262d51bf5a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:50.304408 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3a481e-7384-4b07-960e-dd262d51bf5a None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:50.310841 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc40f571-349f-46a8-a69f-16d4b7d9633e None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:50.360453 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 384/794] 10.222.0.15 () {56 vars in 1135 bytes} [Sun Sep 18 00:43:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:50.366650 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a481e-7384-4b07-960e-dd262d51bf5a None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:50.383705 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5537e-53c4-4c9e-803f-3da9fdcbac5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:50.385278 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5537e-53c4-4c9e-803f-3da9fdcbac5d None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:50.386085 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5537e-53c4-4c9e-803f-3da9fdcbac5d None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:50.386906 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5537e-53c4-4c9e-803f-3da9fdcbac5d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:50.402240 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b5537e-53c4-4c9e-803f-3da9fdcbac5d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:50.405409 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b5537e-53c4-4c9e-803f-3da9fdcbac5d None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:50.430880 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-65b5537e-53c4-4c9e-803f-3da9fdcbac5d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 18 00:43:50.430880 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:50.430880 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:50.430880 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:50.430880 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:50.430880 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:50.430880 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:50.430880 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:50.430880 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:50.430880 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:50.430880 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:50.430880 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:50.430880 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 00:43:50.430880 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 00:43:50.430880 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 00:43:50.430880 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 00:43:50.432743 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:50.432743 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:50.432743 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 00:43:50.432743 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:43:50.432743 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 00:43:50.432743 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:43:50.432743 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:50.432743 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:50.432743 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:50.432743 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:50.432743 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:50.432743 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:50.432743 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:50.432743 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:50.432743 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:50.432743 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:50.432743 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:50.432743 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:50.435232 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:50.435232 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:50.435232 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 00:43:50.435232 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 00:43:50.435232 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 00:43:50.435232 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 00:43:50.435232 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 00:43:50.435232 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 00:43:50.435232 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 18 00:43:50.435232 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:50.439308 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 411/795] 10.222.0.15 () {56 vars in 1117 bytes} [Sun Sep 18 00:43:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 508 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 00:43:50.459138 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5537e-53c4-4c9e-803f-3da9fdcbac5d None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:50.547540 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:50.565568 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:50.570855 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a481e-7384-4b07-960e-dd262d51bf5a None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:50.617031 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6fb83f-eee7-4e93-af9f-29a805430203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:50.619067 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6fb83f-eee7-4e93-af9f-29a805430203 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:50.620140 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6fb83f-eee7-4e93-af9f-29a805430203 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:50.620543 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6fb83f-eee7-4e93-af9f-29a805430203 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:50.637551 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6fb83f-eee7-4e93-af9f-29a805430203 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:50.639718 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6fb83f-eee7-4e93-af9f-29a805430203 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:50.640856 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5537e-53c4-4c9e-803f-3da9fdcbac5d None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:50.667170 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-3f6fb83f-eee7-4e93-af9f-29a805430203 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:50.667170 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:50.667170 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:50.667170 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:50.667170 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:50.667170 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:50.667170 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:50.667170 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:50.667170 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:50.667170 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:50.667170 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:50.667170 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:50.667170 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:43:50.667170 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:43:50.667170 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:43:50.667170 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:43:50.668216 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:50.668216 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:50.668216 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:50.668216 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:50.668216 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:50.668216 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:50.668216 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:50.668216 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:50.668216 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:50.668216 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:50.668216 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:50.668216 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:50.668216 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:50.668216 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:50.668216 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:50.668216 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:50.668216 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:43:50.669127 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:43:50.669127 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:50.669127 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:50.670013 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 385/796] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:43:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:50.673014 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6365383-3df9-4dc5-a359-ae90160d6d1a None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:50.674032 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6365383-3df9-4dc5-a359-ae90160d6d1a None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:50.674821 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6365383-3df9-4dc5-a359-ae90160d6d1a None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:50.682059 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 386/797] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:43:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:43:50.682059 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6365383-3df9-4dc5-a359-ae90160d6d1a None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:50.691368 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32866e8-e7b1-4f6a-a4a6-5c58c3fe2395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:50.692380 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32866e8-e7b1-4f6a-a4a6-5c58c3fe2395 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:50.692896 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32866e8-e7b1-4f6a-a4a6-5c58c3fe2395 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:50.693465 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32866e8-e7b1-4f6a-a4a6-5c58c3fe2395 None admin] PATH_INFO: `/v3/users` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:50.694411 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32866e8-e7b1-4f6a-a4a6-5c58c3fe2395 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:50.694922 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32866e8-e7b1-4f6a-a4a6-5c58c3fe2395 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:50.696670 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32866e8-e7b1-4f6a-a4a6-5c58c3fe2395 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:50.719280 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 412/798] 10.222.0.15 () {56 vars in 1149 bytes} [Sun Sep 18 00:43:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:43:50.721674 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e429e20-c970-4b2b-9f35-21a35c993eab None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:50.722189 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e429e20-c970-4b2b-9f35-21a35c993eab None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:50.722664 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e429e20-c970-4b2b-9f35-21a35c993eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:50.744516 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-1e429e20-c970-4b2b-9f35-21a35c993eab None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:43:50.746527 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-1e429e20-c970-4b2b-9f35-21a35c993eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:43:50.838618 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6365383-3df9-4dc5-a359-ae90160d6d1a None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:50.856914 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 413/799] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:43:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 00:43:50.856914 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e429e20-c970-4b2b-9f35-21a35c993eab None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:50.910151 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d7340-f6ea-4d3b-b59d-259201f08492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:50.911192 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d7340-f6ea-4d3b-b59d-259201f08492 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:50.911709 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d7340-f6ea-4d3b-b59d-259201f08492 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:50.912213 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d7340-f6ea-4d3b-b59d-259201f08492 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:50.914610 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326d7340-f6ea-4d3b-b59d-259201f08492 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:50.915456 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326d7340-f6ea-4d3b-b59d-259201f08492 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:50.918578 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326d7340-f6ea-4d3b-b59d-259201f08492 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:50.930741 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:50.951260 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 387/800] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:43:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:50.957331 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d7340-f6ea-4d3b-b59d-259201f08492 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:50.989152 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:51.054804 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e429e20-c970-4b2b-9f35-21a35c993eab None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:51.108463 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a611107-46ff-43f6-9d10-bc6db9410f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:51.109682 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a611107-46ff-43f6-9d10-bc6db9410f9b None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:51.110205 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a611107-46ff-43f6-9d10-bc6db9410f9b None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:51.110776 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a611107-46ff-43f6-9d10-bc6db9410f9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:51.137812 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a611107-46ff-43f6-9d10-bc6db9410f9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:51.141261 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a611107-46ff-43f6-9d10-bc6db9410f9b None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:51.180884 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-2a611107-46ff-43f6-9d10-bc6db9410f9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:51.180884 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:51.180884 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:51.180884 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:51.180884 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:51.180884 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:51.180884 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:51.180884 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:51.180884 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:51.180884 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:51.180884 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:51.180884 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:51.180884 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:43:51.180884 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:43:51.180884 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:43:51.180884 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:43:51.181838 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:51.181838 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:51.181838 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:51.181838 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:51.181838 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:51.181838 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:51.181838 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:51.181838 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:51.181838 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:51.181838 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:51.181838 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:51.181838 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:51.181838 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:51.181838 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:51.181838 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:51.181838 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:51.181838 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:43:51.182717 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:43:51.182717 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:51.182717 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:51.186394 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d7340-f6ea-4d3b-b59d-259201f08492 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:51.191983 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 414/801] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:43:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:51.198337 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a611107-46ff-43f6-9d10-bc6db9410f9b None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:51.259831 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9749c15-f961-451d-a91c-3b30f5cf4616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:51.260924 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9749c15-f961-451d-a91c-3b30f5cf4616 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:51.261412 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9749c15-f961-451d-a91c-3b30f5cf4616 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:51.262063 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9749c15-f961-451d-a91c-3b30f5cf4616 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:51.280731 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9749c15-f961-451d-a91c-3b30f5cf4616 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:51.282202 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9749c15-f961-451d-a91c-3b30f5cf4616 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:51.306760 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-d9749c15-f961-451d-a91c-3b30f5cf4616 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:43:51.306760 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:51.306760 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:51.306760 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:51.306760 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:51.306760 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:51.306760 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:51.306760 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:51.306760 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:51.306760 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:51.306760 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:51.306760 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:51.306760 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 00:43:51.306760 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 00:43:51.306760 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 00:43:51.308164 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 00:43:51.308164 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:51.308164 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:51.308164 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:51.308164 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:51.308164 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:51.308164 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:51.308164 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:51.308164 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:51.308164 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:51.308164 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:51.308164 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:51.308164 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:51.308164 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:51.308164 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:51.308164 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:51.308164 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:51.309100 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 00:43:51.309100 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 00:43:51.309100 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 00:43:51.309100 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 00:43:51.309100 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 00:43:51.309100 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 00:43:51.309100 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:43:51.309100 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:51.310032 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 388/802] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Sep 18 00:43:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:51.316297 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9749c15-f961-451d-a91c-3b30f5cf4616 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:51.359068 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:51.380548 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a611107-46ff-43f6-9d10-bc6db9410f9b None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:51.441554 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a523d2-2044-46eb-baeb-80a76273d3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:51.442337 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a523d2-2044-46eb-baeb-80a76273d3ab None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:51.442716 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a523d2-2044-46eb-baeb-80a76273d3ab None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:51.443088 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a523d2-2044-46eb-baeb-80a76273d3ab None admin] PATH_INFO: `/v3/domains` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:51.443881 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a523d2-2044-46eb-baeb-80a76273d3ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:51.444321 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a523d2-2044-46eb-baeb-80a76273d3ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:51.447088 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:51.448458 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a523d2-2044-46eb-baeb-80a76273d3ab None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:51.466284 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 415/803] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:43:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:51.468367 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a523d2-2044-46eb-baeb-80a76273d3ab None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:51.511881 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9749c15-f961-451d-a91c-3b30f5cf4616 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:51.577514 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd46e8d-c50f-456b-8f01-4a0075f5bd4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:51.578743 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd46e8d-c50f-456b-8f01-4a0075f5bd4e None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:51.580262 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd46e8d-c50f-456b-8f01-4a0075f5bd4e None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:51.580882 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd46e8d-c50f-456b-8f01-4a0075f5bd4e None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:51.582811 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd46e8d-c50f-456b-8f01-4a0075f5bd4e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:51.583981 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd46e8d-c50f-456b-8f01-4a0075f5bd4e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:51.586713 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd46e8d-c50f-456b-8f01-4a0075f5bd4e None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:51.605953 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 389/804] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Sep 18 00:43:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:43:51.607261 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd46e8d-c50f-456b-8f01-4a0075f5bd4e None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:51.668107 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a523d2-2044-46eb-baeb-80a76273d3ab None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:51.718736 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1652095-0ece-47da-afca-026ed64e90a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:51.719310 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1652095-0ece-47da-afca-026ed64e90a1 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:51.719596 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1652095-0ece-47da-afca-026ed64e90a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:51.720426 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1652095-0ece-47da-afca-026ed64e90a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:51.731615 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd46e8d-c50f-456b-8f01-4a0075f5bd4e None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:51.733028 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1652095-0ece-47da-afca-026ed64e90a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:43:51.742884 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-d1652095-0ece-47da-afca-026ed64e90a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 00:43:51.742884 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:51.742884 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:51.742884 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:51.742884 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:51.742884 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:51.742884 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:51.742884 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:51.742884 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:51.742884 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:51.742884 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:51.742884 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:51.742884 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:43:51.742884 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:43:51.742884 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:43:51.742884 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:43:51.744395 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:43:51.744395 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:43:51.744395 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:43:51.744395 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:43:51.744395 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:51.744395 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:51.744395 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:51.744395 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:51.744395 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:51.744395 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:51.744395 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:51.744395 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:51.744395 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:51.744395 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:51.744395 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:51.744395 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:51.745816 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:51.745816 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:51.745816 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:51.745816 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:51.745816 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:43:51.745816 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:43:51.745816 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:43:51.745816 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:43:51.745816 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:43:51.745816 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:43:51.745816 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 00:43:51.745816 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:51.745816 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 416/805] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Sep 18 00:43:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:51.747101 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20b3c3-db68-444c-a915-a69777a4d70e None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:51.747589 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20b3c3-db68-444c-a915-a69777a4d70e None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:51.748157 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20b3c3-db68-444c-a915-a69777a4d70e None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:51.750596 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 417/806] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:43:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:43:51.752044 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef20b3c3-db68-444c-a915-a69777a4d70e None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:51.757629 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:51.772474 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:51.778366 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3be81e-a806-4959-847c-cadebbf1da2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:51.779033 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3be81e-a806-4959-847c-cadebbf1da2e None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:51.779304 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3be81e-a806-4959-847c-cadebbf1da2e None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:51.779578 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3be81e-a806-4959-847c-cadebbf1da2e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:51.788496 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3be81e-a806-4959-847c-cadebbf1da2e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:51.790014 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3be81e-a806-4959-847c-cadebbf1da2e None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:51.806076 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-5f3be81e-a806-4959-847c-cadebbf1da2e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:43:51.806076 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:51.806076 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:51.806076 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:51.806076 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:51.806076 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:51.806076 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:51.806076 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:51.806076 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:51.806076 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:51.806076 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:51.806076 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:51.806076 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 00:43:51.806076 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 00:43:51.806076 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 00:43:51.807185 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 00:43:51.807185 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:51.807185 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:51.807185 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:51.807185 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:51.807185 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:51.807185 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:51.807185 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:51.807185 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:51.807185 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:51.807185 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:51.807185 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:51.807185 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:51.807185 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:51.807185 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:51.807185 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:51.807185 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:51.808957 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 00:43:51.808957 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 00:43:51.808957 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 00:43:51.808957 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 00:43:51.808957 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 00:43:51.808957 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 00:43:51.808957 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:43:51.808957 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:51.808957 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 390/807] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Sep 18 00:43:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:51.808957 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f758a85-e90f-4965-bdfd-a22248c53173 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:51.808957 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f758a85-e90f-4965-bdfd-a22248c53173 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:51.811333 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f758a85-e90f-4965-bdfd-a22248c53173 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:51.812069 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 391/808] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:43:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:43:51.813728 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f758a85-e90f-4965-bdfd-a22248c53173 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:51.899954 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef20b3c3-db68-444c-a915-a69777a4d70e None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:51.935987 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10166e38-e402-4891-9760-4afccd9bf12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:51.936666 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10166e38-e402-4891-9760-4afccd9bf12e None admin] REQUEST_METHOD: `PUT` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:51.936951 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10166e38-e402-4891-9760-4afccd9bf12e None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:51.937222 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10166e38-e402-4891-9760-4afccd9bf12e None admin] PATH_INFO: `/v3/projects/52ebde8fa3f84ede9ef575f7c0780798/users/d0f16f1f2cb8475d9d5c752f56c4b74d/roles/591d4711dc204cf98003c8b7d7558506` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:51.939747 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10166e38-e402-4891-9760-4afccd9bf12e None admin] RBAC: Authorizing `identity:create_grant(project_id=52ebde8fa3f84ede9ef575f7c0780798, user_id=d0f16f1f2cb8475d9d5c752f56c4b74d, role_id=591d4711dc204cf98003c8b7d7558506)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:51.941222 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10166e38-e402-4891-9760-4afccd9bf12e None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:51.941693 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f758a85-e90f-4965-bdfd-a22248c53173 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:51.956455 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 418/809] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Sep 18 00:43:51 2022] PUT /identity/v3/projects/52ebde8fa3f84ede9ef575f7c0780798/users/d0f16f1f2cb8475d9d5c752f56c4b74d/roles/591d4711dc204cf98003c8b7d7558506 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 00:43:51.958226 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f51e1-a0aa-4c16-9179-92efff1b13e2 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:51.958694 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f51e1-a0aa-4c16-9179-92efff1b13e2 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:51.959171 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f51e1-a0aa-4c16-9179-92efff1b13e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:51.984911 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-823f51e1-a0aa-4c16-9179-92efff1b13e2 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:43:51.987624 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-823f51e1-a0aa-4c16-9179-92efff1b13e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:43:51.994753 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5af5f-3d14-4583-878b-b331e6a58cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:51.995932 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5af5f-3d14-4583-878b-b331e6a58cb1 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:51.996446 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5af5f-3d14-4583-878b-b331e6a58cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:51.996998 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5af5f-3d14-4583-878b-b331e6a58cb1 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:51.998304 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa5af5f-3d14-4583-878b-b331e6a58cb1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:51.999758 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa5af5f-3d14-4583-878b-b331e6a58cb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:52.003272 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa5af5f-3d14-4583-878b-b331e6a58cb1 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:52.028693 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 392/810] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Sep 18 00:43:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:52.028693 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5af5f-3d14-4583-878b-b331e6a58cb1 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:52.081341 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:52.096135 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 419/811] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:43:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 00:43:52.097616 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95a416-0de5-40a4-bc07-16bcd4918181 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:52.097918 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95a416-0de5-40a4-bc07-16bcd4918181 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:52.098205 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95a416-0de5-40a4-bc07-16bcd4918181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:52.123598 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-bb95a416-0de5-40a4-bc07-16bcd4918181 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:43:52.124978 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-bb95a416-0de5-40a4-bc07-16bcd4918181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:43:52.152370 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:52.214570 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5af5f-3d14-4583-878b-b331e6a58cb1 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:52.259538 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 420/812] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:43:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 00:43:52.261505 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb95a416-0de5-40a4-bc07-16bcd4918181 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:52.261819 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a2ef12-c381-42d7-8099-18fddaeac2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:52.262506 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2ef12-c381-42d7-8099-18fddaeac2bf None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:52.262780 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2ef12-c381-42d7-8099-18fddaeac2bf None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:52.263063 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2ef12-c381-42d7-8099-18fddaeac2bf None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:52.263757 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a2ef12-c381-42d7-8099-18fddaeac2bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:52.264110 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a2ef12-c381-42d7-8099-18fddaeac2bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:52.265775 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a2ef12-c381-42d7-8099-18fddaeac2bf None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:52.281604 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 393/813] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Sep 18 00:43:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:52.307389 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a2ef12-c381-42d7-8099-18fddaeac2bf None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:52.492998 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb95a416-0de5-40a4-bc07-16bcd4918181 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:52.511228 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a2ef12-c381-42d7-8099-18fddaeac2bf None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:52.526089 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:52.551773 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb1d71-088d-4d73-9b52-8ba3c7cca391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:52.552895 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb1d71-088d-4d73-9b52-8ba3c7cca391 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:52.553363 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:52.553543 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb1d71-088d-4d73-9b52-8ba3c7cca391 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:52.553680 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb1d71-088d-4d73-9b52-8ba3c7cca391 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:52.571520 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbb1d71-088d-4d73-9b52-8ba3c7cca391 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:52.580827 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee0ba92-b446-4eff-b1e1-9758f261f1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:52.581584 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbb1d71-088d-4d73-9b52-8ba3c7cca391 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:52.581924 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0ba92-b446-4eff-b1e1-9758f261f1f6 None admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:52.582653 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0ba92-b446-4eff-b1e1-9758f261f1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:52.583137 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0ba92-b446-4eff-b1e1-9758f261f1f6 None admin] PATH_INFO: `/v3/projects/52ebde8fa3f84ede9ef575f7c0780798/users/9afbb5a9f364495ca55089dd6ddd7934/roles/5e91422b372b43749fe857ffd7bba774` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:52.604728 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-0dbb1d71-088d-4d73-9b52-8ba3c7cca391 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:52.604728 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:52.604728 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:52.604728 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:52.604728 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:52.604728 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:52.604728 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:52.604728 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:52.604728 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:52.604728 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:52.604728 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:52.604728 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:52.604728 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:43:52.604728 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:43:52.604728 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:43:52.604728 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:43:52.606595 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:52.606595 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:52.606595 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:52.606595 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:52.606595 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:52.606595 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:52.606595 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:52.606595 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:52.606595 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:52.606595 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:52.606595 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:52.606595 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:52.606595 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:52.606595 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:52.606595 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:52.606595 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:52.606595 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:43:52.608341 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:43:52.608341 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:52.608341 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:52.608341 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 421/814] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:43:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:52.615173 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb1d71-088d-4d73-9b52-8ba3c7cca391 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:52.617167 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee0ba92-b446-4eff-b1e1-9758f261f1f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=52ebde8fa3f84ede9ef575f7c0780798, user_id=9afbb5a9f364495ca55089dd6ddd7934, role_id=5e91422b372b43749fe857ffd7bba774)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:52.620617 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee0ba92-b446-4eff-b1e1-9758f261f1f6 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:52.649662 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 394/815] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Sep 18 00:43:52 2022] PUT /identity/v3/projects/52ebde8fa3f84ede9ef575f7c0780798/users/9afbb5a9f364495ca55089dd6ddd7934/roles/5e91422b372b43749fe857ffd7bba774 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 00:43:52.651208 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee0ba92-b446-4eff-b1e1-9758f261f1f6 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:52.865625 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb1d71-088d-4d73-9b52-8ba3c7cca391 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:52.869748 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee0ba92-b446-4eff-b1e1-9758f261f1f6 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:52.935553 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160fe297-8600-4f0a-b7c3-61409a82cff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:52.936481 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160fe297-8600-4f0a-b7c3-61409a82cff8 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:52.936883 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160fe297-8600-4f0a-b7c3-61409a82cff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:52.937342 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160fe297-8600-4f0a-b7c3-61409a82cff8 None admin] PATH_INFO: `/v3/services/network` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:52.938289 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160fe297-8600-4f0a-b7c3-61409a82cff8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:52.940980 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160fe297-8600-4f0a-b7c3-61409a82cff8 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:52.956350 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf23d99-e869-4588-ba77-7ea80d94c285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:52.957394 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf23d99-e869-4588-ba77-7ea80d94c285 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:52.957879 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf23d99-e869-4588-ba77-7ea80d94c285 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:52.958035 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-160fe297-8600-4f0a-b7c3-61409a82cff8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 18 00:43:52.958035 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:52.958035 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 18 00:43:52.958035 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 18 00:43:52.958035 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 18 00:43:52.958035 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 18 00:43:52.958035 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 18 00:43:52.958035 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 00:43:52.958035 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 18 00:43:52.958035 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:52.958035 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 18 00:43:52.958035 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:52.958035 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:52.958035 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:52.958035 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:52.958035 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:52.958035 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:52.959800 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:52.959800 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:52.959800 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:52.959800 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:52.959800 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:52.959800 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:52.959800 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 18 00:43:52.959800 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 18 00:43:52.959800 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 18 00:43:52.959800 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 18 00:43:52.959800 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:52.959800 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:52.959800 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:52.959800 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:52.959800 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:52.959800 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:52.962386 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:52.962386 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:52.962386 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:52.962386 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:52.962386 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:52.962386 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:52.962386 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:52.962386 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:52.962386 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:52.962386 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:52.962386 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 18 00:43:52.962386 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 00:43:52.962386 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 18 00:43:52.962386 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:52.965539 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf23d99-e869-4588-ba77-7ea80d94c285 None admin] PATH_INFO: `/v3/domains` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:52.965539 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf23d99-e869-4588-ba77-7ea80d94c285 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:52.965539 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf23d99-e869-4588-ba77-7ea80d94c285 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:52.966454 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 395/816] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Sep 18 00:43:52 2022] GET /identity/v3/services/network => generated 88 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:52.966454 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160fe297-8600-4f0a-b7c3-61409a82cff8 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:52.966899 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf23d99-e869-4588-ba77-7ea80d94c285 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:52.982546 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 422/817] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:43:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:43:52.987305 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf23d99-e869-4588-ba77-7ea80d94c285 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:53.009086 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:53.066517 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:53.160216 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160fe297-8600-4f0a-b7c3-61409a82cff8 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:53.168262 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf23d99-e869-4588-ba77-7ea80d94c285 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:53.230593 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48653ff9-cac7-4873-afda-67a257270edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:53.232082 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48653ff9-cac7-4873-afda-67a257270edc None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:53.232737 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48653ff9-cac7-4873-afda-67a257270edc None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:53.233264 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48653ff9-cac7-4873-afda-67a257270edc None admin] PATH_INFO: `/v3/services` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:53.233655 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eb48c1-ebe0-401a-91ef-8ce60cd1507b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:53.234525 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48653ff9-cac7-4873-afda-67a257270edc None admin] RBAC: Adding query filter params (name=network) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:53.234754 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb48c1-ebe0-401a-91ef-8ce60cd1507b None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:53.235188 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48653ff9-cac7-4873-afda-67a257270edc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:53.235353 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb48c1-ebe0-401a-91ef-8ce60cd1507b None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:53.235776 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb48c1-ebe0-401a-91ef-8ce60cd1507b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:53.236870 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eb48c1-ebe0-401a-91ef-8ce60cd1507b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:53.238102 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48653ff9-cac7-4873-afda-67a257270edc None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:53.239406 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eb48c1-ebe0-401a-91ef-8ce60cd1507b None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:53.247169 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 423/818] 10.222.0.15 () {56 vars in 1112 bytes} [Sun Sep 18 00:43:52 2022] GET /identity/v3/services?name=network => generated 124 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:53.248925 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48653ff9-cac7-4873-afda-67a257270edc None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:53.258307 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-02eb48c1-ebe0-401a-91ef-8ce60cd1507b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 18 00:43:53.258307 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:53.258307 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 18 00:43:53.258307 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 18 00:43:53.258307 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 18 00:43:53.258307 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 18 00:43:53.258307 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 18 00:43:53.258307 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 00:43:53.258307 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 18 00:43:53.258307 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:53.258307 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 18 00:43:53.258307 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:53.258307 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:53.258307 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:53.258307 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:53.258307 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:53.258307 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:53.260422 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:53.260422 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:53.260422 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:53.260422 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:53.260422 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:53.260422 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:53.260422 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 18 00:43:53.260422 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 18 00:43:53.260422 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 18 00:43:53.260422 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 18 00:43:53.260422 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:53.260422 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:53.260422 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:53.260422 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:53.260422 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:53.260422 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:53.263197 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:53.263197 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:53.263197 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:53.263197 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:53.263197 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:53.263197 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:53.263197 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:53.263197 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:53.263197 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:53.263197 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:53.263197 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 18 00:43:53.263197 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 00:43:53.263197 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 18 00:43:53.263197 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:53.263197 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 396/819] 10.222.0.15 () {56 vars in 1129 bytes} [Sun Sep 18 00:43:52 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:53.275952 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eb48c1-ebe0-401a-91ef-8ce60cd1507b None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:53.471599 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:53.485590 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:53.490957 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eb48c1-ebe0-401a-91ef-8ce60cd1507b None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:53.491827 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48653ff9-cac7-4873-afda-67a257270edc None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:53.560590 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c9f873-fc02-4684-b09d-2d5a9748521c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:53.561534 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b3a1c6-61eb-4c77-b9b4-412a44b211cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:53.562002 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9f873-fc02-4684-b09d-2d5a9748521c None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:53.562082 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9f873-fc02-4684-b09d-2d5a9748521c None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:53.562551 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3a1c6-61eb-4c77-b9b4-412a44b211cf None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:53.562656 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9f873-fc02-4684-b09d-2d5a9748521c None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:53.563020 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3a1c6-61eb-4c77-b9b4-412a44b211cf None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:53.563502 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3a1c6-61eb-4c77-b9b4-412a44b211cf None admin] PATH_INFO: `/v3/users/nova` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:53.564157 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c9f873-fc02-4684-b09d-2d5a9748521c None admin] RBAC: Adding query filter params (type=network) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:53.564548 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c9f873-fc02-4684-b09d-2d5a9748521c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:53.566860 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c9f873-fc02-4684-b09d-2d5a9748521c None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:53.574931 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 397/820] 10.222.0.15 () {56 vars in 1112 bytes} [Sun Sep 18 00:43:53 2022] GET /identity/v3/services?type=network => generated 350 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:53.576265 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c9f873-fc02-4684-b09d-2d5a9748521c None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:53.584340 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b3a1c6-61eb-4c77-b9b4-412a44b211cf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:53.587176 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b3a1c6-61eb-4c77-b9b4-412a44b211cf None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:53.615703 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-d9b3a1c6-61eb-4c77-b9b4-412a44b211cf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 18 00:43:53.615703 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:53.615703 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:53.615703 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:53.615703 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:53.615703 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:53.615703 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:53.615703 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:53.615703 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:53.615703 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:53.615703 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:53.615703 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:53.615703 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 00:43:53.615703 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 00:43:53.615703 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 00:43:53.615703 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 00:43:53.616724 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:53.616724 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:53.616724 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 00:43:53.616724 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:43:53.616724 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 00:43:53.616724 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:43:53.616724 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:53.616724 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:53.616724 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:53.616724 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:53.616724 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:53.616724 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:53.616724 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:53.616724 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:53.616724 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:53.616724 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:53.616724 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:53.616724 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:53.617633 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:53.617633 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:53.617633 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 00:43:53.617633 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 00:43:53.617633 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 00:43:53.617633 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 00:43:53.617633 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 00:43:53.617633 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 00:43:53.617633 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 18 00:43:53.617633 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:53.624576 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 424/821] 10.222.0.15 () {56 vars in 1093 bytes} [Sun Sep 18 00:43:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:53.626197 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b3a1c6-61eb-4c77-b9b4-412a44b211cf None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:53.718078 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c9f873-fc02-4684-b09d-2d5a9748521c None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:53.773764 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aed744-9023-450a-ae66-c4b5fb821ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:53.774634 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aed744-9023-450a-ae66-c4b5fb821ef9 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:53.775119 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aed744-9023-450a-ae66-c4b5fb821ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:53.775590 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aed744-9023-450a-ae66-c4b5fb821ef9 None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:53.776761 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aed744-9023-450a-ae66-c4b5fb821ef9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:53.777301 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aed744-9023-450a-ae66-c4b5fb821ef9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:53.779922 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aed744-9023-450a-ae66-c4b5fb821ef9 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:53.796392 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 398/822] 10.222.0.15 () {56 vars in 1124 bytes} [Sun Sep 18 00:43:53 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:53.798106 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aed744-9023-450a-ae66-c4b5fb821ef9 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:53.832071 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b3a1c6-61eb-4c77-b9b4-412a44b211cf None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:53.842732 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:53.902408 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c1c44-7ea9-4129-a2e9-3e0db8332eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:53.903436 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c1c44-7ea9-4129-a2e9-3e0db8332eec None admin] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:53.903950 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c1c44-7ea9-4129-a2e9-3e0db8332eec None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:53.904446 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c1c44-7ea9-4129-a2e9-3e0db8332eec None admin] PATH_INFO: `/v3/endpoints` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:53.905659 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726c1c44-7ea9-4129-a2e9-3e0db8332eec None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:53.908519 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726c1c44-7ea9-4129-a2e9-3e0db8332eec None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:53.954782 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 425/823] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Sep 18 00:43:53 2022] POST /identity/v3/endpoints => generated 337 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 00:43:53.964996 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c1c44-7ea9-4129-a2e9-3e0db8332eec None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:54.010518 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aed744-9023-450a-ae66-c4b5fb821ef9 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:54.031125 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:54.105181 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1439c63e-9ce6-48fa-bdda-1890b8726d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:54.106164 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439c63e-9ce6-48fa-bdda-1890b8726d83 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:54.106621 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439c63e-9ce6-48fa-bdda-1890b8726d83 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:54.107070 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439c63e-9ce6-48fa-bdda-1890b8726d83 None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:54.108436 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1439c63e-9ce6-48fa-bdda-1890b8726d83 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:54.108942 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1439c63e-9ce6-48fa-bdda-1890b8726d83 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:54.115402 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1439c63e-9ce6-48fa-bdda-1890b8726d83 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:54.168393 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 399/824] 10.222.0.15 () {56 vars in 1133 bytes} [Sun Sep 18 00:43:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:54.181685 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1439c63e-9ce6-48fa-bdda-1890b8726d83 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:54.233747 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c1c44-7ea9-4129-a2e9-3e0db8332eec None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:54.335438 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60351bf8-da31-4f02-996b-daf82e9ee49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:54.336382 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60351bf8-da31-4f02-996b-daf82e9ee49f None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:54.336875 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60351bf8-da31-4f02-996b-daf82e9ee49f None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:54.337360 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60351bf8-da31-4f02-996b-daf82e9ee49f None admin] PATH_INFO: `/v3/services` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:54.338548 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60351bf8-da31-4f02-996b-daf82e9ee49f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:54.339092 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60351bf8-da31-4f02-996b-daf82e9ee49f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:54.341785 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60351bf8-da31-4f02-996b-daf82e9ee49f None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:54.369271 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 426/825] 10.222.0.15 () {56 vars in 1124 bytes} [Sun Sep 18 00:43:53 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 414 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:54.376460 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60351bf8-da31-4f02-996b-daf82e9ee49f None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:54.388305 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:54.458706 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1439c63e-9ce6-48fa-bdda-1890b8726d83 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:54.544934 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ab4ad0-8f28-49a7-b5ee-0287b571da44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:54.546462 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab4ad0-8f28-49a7-b5ee-0287b571da44 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:54.546949 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab4ad0-8f28-49a7-b5ee-0287b571da44 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:54.547633 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab4ad0-8f28-49a7-b5ee-0287b571da44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:54.603229 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:54.648033 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60351bf8-da31-4f02-996b-daf82e9ee49f None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:54.725245 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9979af1f-afe8-4964-8222-6cc3a21831d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:54.725552 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ab4ad0-8f28-49a7-b5ee-0287b571da44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:54.726855 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979af1f-afe8-4964-8222-6cc3a21831d9 None admin] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:54.727580 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979af1f-afe8-4964-8222-6cc3a21831d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:54.728310 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979af1f-afe8-4964-8222-6cc3a21831d9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:54.728460 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ab4ad0-8f28-49a7-b5ee-0287b571da44 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:54.729960 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9979af1f-afe8-4964-8222-6cc3a21831d9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:54.733276 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9979af1f-afe8-4964-8222-6cc3a21831d9 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:54.784168 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 427/826] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Sep 18 00:43:54 2022] POST /identity/v3/endpoints => generated 346 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 00:43:54.894490 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:54.930704 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 400/827] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Sep 18 00:43:54 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 754 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 18 00:43:54.936434 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9979af1f-afe8-4964-8222-6cc3a21831d9 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:55.065477 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9979af1f-afe8-4964-8222-6cc3a21831d9 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:55.116340 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:55.124724 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c06ac69-32ee-480d-b6a0-25071909c4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:55.126271 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06ac69-32ee-480d-b6a0-25071909c4a1 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:55.127086 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06ac69-32ee-480d-b6a0-25071909c4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:55.127994 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06ac69-32ee-480d-b6a0-25071909c4a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:55.148262 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c06ac69-32ee-480d-b6a0-25071909c4a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:55.151139 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c06ac69-32ee-480d-b6a0-25071909c4a1 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:55.179735 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-2c06ac69-32ee-480d-b6a0-25071909c4a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:55.179735 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:55.179735 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:55.179735 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:55.179735 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:55.179735 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:55.179735 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:55.179735 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:55.179735 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:55.179735 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:55.179735 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:55.179735 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:55.179735 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:43:55.179735 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:43:55.179735 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:43:55.179735 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:43:55.180776 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:55.180776 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:55.180776 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:55.180776 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:55.180776 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:55.180776 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:55.180776 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:55.180776 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:55.180776 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:55.180776 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:55.180776 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:55.180776 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:55.180776 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:55.180776 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:55.180776 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:55.180776 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:55.180776 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:43:55.181634 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:43:55.181634 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:55.181634 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:55.182250 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 428/828] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:43:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:55.191931 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ab4ad0-8f28-49a7-b5ee-0287b571da44 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:55.328174 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eafc13-1aa4-4602-a08b-93e97ba1da84 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:55.328686 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eafc13-1aa4-4602-a08b-93e97ba1da84 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:55.329209 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eafc13-1aa4-4602-a08b-93e97ba1da84 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:55.336259 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 429/829] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:43:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:43:55.341117 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d8578f-a2ec-48c8-8ad0-8044bdd11a94 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:55.341607 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d8578f-a2ec-48c8-8ad0-8044bdd11a94 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:55.342069 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d8578f-a2ec-48c8-8ad0-8044bdd11a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:55.362247 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ab4ad0-8f28-49a7-b5ee-0287b571da44 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:55.368872 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-e5d8578f-a2ec-48c8-8ad0-8044bdd11a94 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:43:55.369343 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-e5d8578f-a2ec-48c8-8ad0-8044bdd11a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:43:55.427449 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d6eab-c6e0-4538-b734-d1f9ea6514a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:55.429232 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d6eab-c6e0-4538-b734-d1f9ea6514a9 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:55.430172 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d6eab-c6e0-4538-b734-d1f9ea6514a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:55.431059 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d6eab-c6e0-4538-b734-d1f9ea6514a9 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:55.432716 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6d6eab-c6e0-4538-b734-d1f9ea6514a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:55.433713 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6d6eab-c6e0-4538-b734-d1f9ea6514a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:55.436744 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6d6eab-c6e0-4538-b734-d1f9ea6514a9 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:55.452924 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 430/830] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:43:55 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 00:43:55.463233 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 401/831] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:43:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:55.472770 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d8578f-a2ec-48c8-8ad0-8044bdd11a94 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:55.483910 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7175f1-0dd7-4dbb-b280-d6153aa9ceca None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:55.483910 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7175f1-0dd7-4dbb-b280-d6153aa9ceca None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:55.483910 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7175f1-0dd7-4dbb-b280-d6153aa9ceca None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:55.488081 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 402/832] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:43:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 18 00:43:55.496137 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719dc6a-fe2b-4e7c-b0cd-b7824ff22da9 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:55.496681 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719dc6a-fe2b-4e7c-b0cd-b7824ff22da9 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:55.497149 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719dc6a-fe2b-4e7c-b0cd-b7824ff22da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:55.530737 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-c719dc6a-fe2b-4e7c-b0cd-b7824ff22da9 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:43:55.533497 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-c719dc6a-fe2b-4e7c-b0cd-b7824ff22da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:43:55.600337 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:55.640857 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d8578f-a2ec-48c8-8ad0-8044bdd11a94 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:55.661290 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:55.687117 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36c22e8-1afc-4878-a7c7-1ea1b9b203db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:55.688157 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c22e8-1afc-4878-a7c7-1ea1b9b203db None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:55.689592 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c22e8-1afc-4878-a7c7-1ea1b9b203db None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:55.690182 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c22e8-1afc-4878-a7c7-1ea1b9b203db None admin] PATH_INFO: `/v3/projects/service` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:55.698361 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36c22e8-1afc-4878-a7c7-1ea1b9b203db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:55.700306 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36c22e8-1afc-4878-a7c7-1ea1b9b203db None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:55.715749 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 403/833] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:43:55 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 18 00:43:55.716407 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-f36c22e8-1afc-4878-a7c7-1ea1b9b203db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:43:55.716407 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:55.716407 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:55.716407 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:55.716407 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:55.716407 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:55.716407 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:55.716407 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:55.716407 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:55.716407 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:55.716407 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:55.716407 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:55.716407 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 00:43:55.716407 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 00:43:55.716407 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 00:43:55.717260 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 00:43:55.717260 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:55.717260 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:55.717260 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:55.717260 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:55.717260 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:55.717260 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:55.717260 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:55.717260 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:55.717260 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:55.717260 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:55.717260 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:55.717260 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:55.717260 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:55.717260 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:55.717260 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:55.717260 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:55.718131 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 00:43:55.718131 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 00:43:55.718131 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 00:43:55.718131 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 00:43:55.718131 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 00:43:55.718131 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 00:43:55.718131 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:43:55.718131 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:55.721174 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 431/834] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Sep 18 00:43:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:55.727819 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c719dc6a-fe2b-4e7c-b0cd-b7824ff22da9 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:55.885656 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36c22e8-1afc-4878-a7c7-1ea1b9b203db None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:55.919981 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c719dc6a-fe2b-4e7c-b0cd-b7824ff22da9 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:55.967909 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91466d01-031a-4ecd-a80b-4d3605b67985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:55.969092 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91466d01-031a-4ecd-a80b-4d3605b67985 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:55.969377 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91466d01-031a-4ecd-a80b-4d3605b67985 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:55.969698 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91466d01-031a-4ecd-a80b-4d3605b67985 None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:55.970441 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91466d01-031a-4ecd-a80b-4d3605b67985 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:55.970753 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91466d01-031a-4ecd-a80b-4d3605b67985 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:55.973193 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91466d01-031a-4ecd-a80b-4d3605b67985 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:55.989798 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 404/835] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Sep 18 00:43:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:56.001029 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91466d01-031a-4ecd-a80b-4d3605b67985 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:56.048383 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:56.066095 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36c22e8-1afc-4878-a7c7-1ea1b9b203db None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:56.124609 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6107e0-c391-4871-8d9b-f382d36d5bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:56.125453 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6107e0-c391-4871-8d9b-f382d36d5bad None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:56.125734 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6107e0-c391-4871-8d9b-f382d36d5bad None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:56.126137 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6107e0-c391-4871-8d9b-f382d36d5bad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:56.138105 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91466d01-031a-4ecd-a80b-4d3605b67985 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:56.142783 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6107e0-c391-4871-8d9b-f382d36d5bad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:43:56.148910 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-4f6107e0-c391-4871-8d9b-f382d36d5bad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 00:43:56.148910 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:56.148910 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:56.148910 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:56.148910 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:56.148910 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:56.148910 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:56.148910 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:56.148910 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:56.148910 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:56.148910 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:56.148910 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:56.148910 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:43:56.148910 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:43:56.148910 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:43:56.148910 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:43:56.152527 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:43:56.152527 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:43:56.152527 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:43:56.152527 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:43:56.152527 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:56.152527 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:56.152527 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:56.152527 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:56.152527 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:56.152527 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:56.152527 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:56.152527 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:56.152527 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:56.152527 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:56.152527 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:56.152527 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:56.153571 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:56.153571 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:56.153571 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:56.153571 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:56.153571 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:43:56.153571 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:43:56.153571 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:43:56.153571 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:43:56.153571 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:43:56.153571 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:43:56.153571 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 00:43:56.153571 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:56.153571 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 432/836] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Sep 18 00:43:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:56.153571 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6107e0-c391-4871-8d9b-f382d36d5bad None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:56.195444 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1893a58c-a8cb-465e-96d0-25ed9a9d113b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:56.196107 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1893a58c-a8cb-465e-96d0-25ed9a9d113b None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:56.196397 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1893a58c-a8cb-465e-96d0-25ed9a9d113b None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:56.196674 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1893a58c-a8cb-465e-96d0-25ed9a9d113b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:56.197435 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1893a58c-a8cb-465e-96d0-25ed9a9d113b None admin] RBAC: Adding query filter params (role.id=591d4711dc204cf98003c8b7d7558506, scope.project.id=52ebde8fa3f84ede9ef575f7c0780798, user.id=264c183fff8a49478eea4aceea73273e) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:56.197748 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1893a58c-a8cb-465e-96d0-25ed9a9d113b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:56.199303 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1893a58c-a8cb-465e-96d0-25ed9a9d113b None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:56.201430 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:56.211938 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 405/837] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Sep 18 00:43:55 2022] GET /identity/v3/role_assignments?user.id=264c183fff8a49478eea4aceea73273e&scope.project.id=52ebde8fa3f84ede9ef575f7c0780798&role.id=591d4711dc204cf98003c8b7d7558506 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:56.211938 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1893a58c-a8cb-465e-96d0-25ed9a9d113b None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:56.289181 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6107e0-c391-4871-8d9b-f382d36d5bad None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:56.336868 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad7bcb0-3f1e-4739-94dc-fdac721d08dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:56.337760 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7bcb0-3f1e-4739-94dc-fdac721d08dc None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:56.338145 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7bcb0-3f1e-4739-94dc-fdac721d08dc None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:56.338523 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7bcb0-3f1e-4739-94dc-fdac721d08dc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:56.354864 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad7bcb0-3f1e-4739-94dc-fdac721d08dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:43:56.361827 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-7ad7bcb0-3f1e-4739-94dc-fdac721d08dc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 18 00:43:56.361827 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:56.361827 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:56.361827 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:56.361827 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:56.361827 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:56.361827 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:56.361827 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:56.361827 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:56.361827 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:56.361827 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:56.361827 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:56.361827 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:43:56.361827 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:43:56.361827 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:43:56.361827 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:43:56.364047 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:43:56.364047 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:43:56.364047 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:43:56.364047 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:43:56.364047 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:56.364047 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:56.364047 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:56.364047 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:56.364047 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:56.364047 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:56.364047 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:56.364047 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:56.364047 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:56.364047 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:56.364047 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:56.364047 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:56.366725 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:56.366725 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:56.366725 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:56.366725 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:56.366725 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:43:56.366725 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:43:56.366725 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:43:56.366725 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:43:56.366725 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:43:56.366725 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:43:56.366725 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 18 00:43:56.366725 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:56.368940 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:56.372035 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 433/838] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Sep 18 00:43:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:56.372035 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad7bcb0-3f1e-4739-94dc-fdac721d08dc None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:56.385586 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1893a58c-a8cb-465e-96d0-25ed9a9d113b None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:56.434614 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda61bd9-5ba8-4020-9b7b-92dbe4024edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:56.435623 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda61bd9-5ba8-4020-9b7b-92dbe4024edd None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:56.436152 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda61bd9-5ba8-4020-9b7b-92dbe4024edd None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:56.436656 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda61bd9-5ba8-4020-9b7b-92dbe4024edd None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:56.437547 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda61bd9-5ba8-4020-9b7b-92dbe4024edd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:56.438067 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda61bd9-5ba8-4020-9b7b-92dbe4024edd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:56.439794 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda61bd9-5ba8-4020-9b7b-92dbe4024edd None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:56.450624 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 406/839] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Sep 18 00:43:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:56.461492 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda61bd9-5ba8-4020-9b7b-92dbe4024edd None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:56.523458 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:56.534048 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad7bcb0-3f1e-4739-94dc-fdac721d08dc None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:56.575731 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed190a1-1054-4325-898a-bb777168b53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:56.576205 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed190a1-1054-4325-898a-bb777168b53d None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:56.576461 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed190a1-1054-4325-898a-bb777168b53d None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:56.576734 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed190a1-1054-4325-898a-bb777168b53d None admin] PATH_INFO: `/v3/roles` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:56.578077 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed190a1-1054-4325-898a-bb777168b53d None admin] RBAC: Adding query filter params (name=service) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:56.578077 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed190a1-1054-4325-898a-bb777168b53d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:56.579148 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed190a1-1054-4325-898a-bb777168b53d None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:56.596987 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 434/840] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Sep 18 00:43:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:56.604231 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed190a1-1054-4325-898a-bb777168b53d None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:56.625136 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda61bd9-5ba8-4020-9b7b-92dbe4024edd None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:56.663925 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d3ffb4-00b3-434c-8a5e-eaeecf12bb80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:56.664621 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3ffb4-00b3-434c-8a5e-eaeecf12bb80 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:56.664906 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3ffb4-00b3-434c-8a5e-eaeecf12bb80 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:56.665186 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3ffb4-00b3-434c-8a5e-eaeecf12bb80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:56.677898 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d3ffb4-00b3-434c-8a5e-eaeecf12bb80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:56.679723 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d3ffb4-00b3-434c-8a5e-eaeecf12bb80 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:56.695433 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-d1d3ffb4-00b3-434c-8a5e-eaeecf12bb80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:56.695433 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:56.695433 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:56.695433 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:56.695433 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:56.695433 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:56.695433 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:56.695433 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:56.695433 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:56.695433 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:56.695433 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:56.695433 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:56.695433 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:43:56.695433 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:43:56.695433 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:43:56.695433 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:43:56.696548 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:56.696548 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:56.696548 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:56.696548 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:56.696548 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:56.696548 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:56.696548 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:56.696548 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:56.696548 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:56.696548 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:56.696548 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:56.696548 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:56.696548 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:56.696548 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:56.696548 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:56.696548 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:56.696548 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:43:56.697424 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:43:56.697424 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:56.697424 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:56.697424 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 407/841] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:43:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:56.706597 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d3ffb4-00b3-434c-8a5e-eaeecf12bb80 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:56.722522 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:56.742820 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed190a1-1054-4325-898a-bb777168b53d None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:56.786320 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce286c53-0aef-4909-bad1-05df864aa224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:56.787267 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce286c53-0aef-4909-bad1-05df864aa224 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:56.787555 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce286c53-0aef-4909-bad1-05df864aa224 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:56.787863 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce286c53-0aef-4909-bad1-05df864aa224 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:56.809905 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce286c53-0aef-4909-bad1-05df864aa224 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:56.812767 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce286c53-0aef-4909-bad1-05df864aa224 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:56.840759 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-ce286c53-0aef-4909-bad1-05df864aa224 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:56.840759 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:56.840759 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:56.840759 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:56.840759 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:56.840759 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:56.840759 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:56.840759 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:56.840759 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:56.840759 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:56.840759 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:56.840759 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:56.840759 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:43:56.840759 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:43:56.840759 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:43:56.840759 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:43:56.841738 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:56.841738 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:56.841738 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:56.841738 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:56.841738 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:56.841738 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:56.841738 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:56.841738 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:56.841738 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:56.841738 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:56.841738 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:56.841738 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:56.841738 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:56.841738 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:56.841738 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:56.841738 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:56.841738 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:43:56.842633 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:43:56.842633 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:56.842633 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:56.848504 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 435/842] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:43:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 00:43:56.853015 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce286c53-0aef-4909-bad1-05df864aa224 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:56.864739 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d3ffb4-00b3-434c-8a5e-eaeecf12bb80 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:56.915425 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd50cc43-235c-4e2d-a3eb-b00f47fda05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:56.916375 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:56.917381 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50cc43-235c-4e2d-a3eb-b00f47fda05f None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:56.917716 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50cc43-235c-4e2d-a3eb-b00f47fda05f None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:56.918067 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50cc43-235c-4e2d-a3eb-b00f47fda05f None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:56.918879 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd50cc43-235c-4e2d-a3eb-b00f47fda05f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:56.919278 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd50cc43-235c-4e2d-a3eb-b00f47fda05f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:56.920821 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd50cc43-235c-4e2d-a3eb-b00f47fda05f None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:56.946715 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 408/843] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:43:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:56.955235 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd50cc43-235c-4e2d-a3eb-b00f47fda05f None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:57.025466 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce286c53-0aef-4909-bad1-05df864aa224 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:57.031450 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:57.072095 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9207e6a0-7f76-4bbd-a7a3-8ba73bcb6882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:57.072914 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9207e6a0-7f76-4bbd-a7a3-8ba73bcb6882 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:57.073322 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9207e6a0-7f76-4bbd-a7a3-8ba73bcb6882 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:57.073675 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9207e6a0-7f76-4bbd-a7a3-8ba73bcb6882 None admin] PATH_INFO: `/v3/domains` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:57.074481 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9207e6a0-7f76-4bbd-a7a3-8ba73bcb6882 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:57.074862 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9207e6a0-7f76-4bbd-a7a3-8ba73bcb6882 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:57.076565 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9207e6a0-7f76-4bbd-a7a3-8ba73bcb6882 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:57.088583 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd50cc43-235c-4e2d-a3eb-b00f47fda05f None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:57.092803 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 436/844] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:43:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:43:57.101174 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9207e6a0-7f76-4bbd-a7a3-8ba73bcb6882 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:57.150889 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb92527-a74c-4c22-9a24-26fa8f43c2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:57.151964 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb92527-a74c-4c22-9a24-26fa8f43c2b5 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:57.152456 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb92527-a74c-4c22-9a24-26fa8f43c2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:57.152931 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb92527-a74c-4c22-9a24-26fa8f43c2b5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:57.175830 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb92527-a74c-4c22-9a24-26fa8f43c2b5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:57.179590 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb92527-a74c-4c22-9a24-26fa8f43c2b5 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:57.204395 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:57.210992 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-ffb92527-a74c-4c22-9a24-26fa8f43c2b5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 18 00:43:57.210992 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:57.210992 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:57.210992 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:57.210992 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:57.210992 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:57.210992 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:57.210992 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:57.210992 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:57.210992 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:57.210992 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:57.210992 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:57.210992 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 00:43:57.210992 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 00:43:57.210992 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 00:43:57.210992 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 00:43:57.212051 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:57.212051 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:57.212051 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 00:43:57.212051 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:43:57.212051 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 00:43:57.212051 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:43:57.212051 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:57.212051 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:57.212051 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:57.212051 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:57.212051 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:57.212051 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:57.212051 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:57.212051 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:57.212051 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:57.212051 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:57.212051 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:57.212051 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:57.213167 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:57.213167 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:57.213167 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 00:43:57.213167 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 00:43:57.213167 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 00:43:57.213167 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 00:43:57.213167 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 00:43:57.213167 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 00:43:57.213167 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 18 00:43:57.213167 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:57.215761 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 409/845] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Sep 18 00:43:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 00:43:57.225822 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb92527-a74c-4c22-9a24-26fa8f43c2b5 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:57.263038 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9207e6a0-7f76-4bbd-a7a3-8ba73bcb6882 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:57.334557 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad33fb68-9c96-4038-9c36-42daf765f853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:57.335746 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33fb68-9c96-4038-9c36-42daf765f853 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:57.336562 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33fb68-9c96-4038-9c36-42daf765f853 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:57.337060 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33fb68-9c96-4038-9c36-42daf765f853 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:57.352413 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad33fb68-9c96-4038-9c36-42daf765f853 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:57.355034 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad33fb68-9c96-4038-9c36-42daf765f853 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:57.378431 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-ad33fb68-9c96-4038-9c36-42daf765f853 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 18 00:43:57.378431 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:57.378431 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:57.378431 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:57.378431 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:57.378431 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:57.378431 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:57.378431 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:57.378431 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:57.378431 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:57.378431 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:57.378431 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:57.378431 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 00:43:57.378431 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 00:43:57.378431 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 00:43:57.378431 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 00:43:57.380569 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:57.380569 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:57.380569 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 00:43:57.380569 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:43:57.380569 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 00:43:57.380569 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:43:57.380569 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:57.380569 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:57.380569 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:57.380569 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:57.380569 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:57.380569 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:57.380569 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:57.380569 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:57.380569 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:57.380569 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:57.380569 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:57.380569 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:57.382711 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:57.382711 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:57.382711 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 00:43:57.382711 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 00:43:57.382711 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 00:43:57.382711 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 00:43:57.382711 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 00:43:57.382711 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 00:43:57.382711 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 18 00:43:57.382711 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:57.392350 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 437/846] 10.222.0.15 () {56 vars in 1117 bytes} [Sun Sep 18 00:43:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:57.395829 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad33fb68-9c96-4038-9c36-42daf765f853 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:57.434882 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb92527-a74c-4c22-9a24-26fa8f43c2b5 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:57.485524 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:57.507954 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831c2af4-840f-4886-8a26-490ade199389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:57.509374 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c2af4-840f-4886-8a26-490ade199389 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:57.510273 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c2af4-840f-4886-8a26-490ade199389 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:57.510921 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c2af4-840f-4886-8a26-490ade199389 None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:57.512607 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831c2af4-840f-4886-8a26-490ade199389 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:57.513496 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831c2af4-840f-4886-8a26-490ade199389 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:57.516961 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831c2af4-840f-4886-8a26-490ade199389 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:57.553020 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 410/847] 10.222.0.15 () {56 vars in 1135 bytes} [Sun Sep 18 00:43:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:57.562033 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831c2af4-840f-4886-8a26-490ade199389 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:57.595397 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad33fb68-9c96-4038-9c36-42daf765f853 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:57.653078 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:57.671651 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e1b43-bcb6-4143-a47f-291f859c5656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:57.674640 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e1b43-bcb6-4143-a47f-291f859c5656 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:57.676141 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e1b43-bcb6-4143-a47f-291f859c5656 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:57.677364 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e1b43-bcb6-4143-a47f-291f859c5656 None admin] PATH_INFO: `/v3/users` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:57.679099 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388e1b43-bcb6-4143-a47f-291f859c5656 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:57.680121 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388e1b43-bcb6-4143-a47f-291f859c5656 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:57.683181 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388e1b43-bcb6-4143-a47f-291f859c5656 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:57.726107 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 438/848] 10.222.0.15 () {56 vars in 1149 bytes} [Sun Sep 18 00:43:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:57.729426 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e1b43-bcb6-4143-a47f-291f859c5656 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:57.744536 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831c2af4-840f-4886-8a26-490ade199389 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:57.800829 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a4cd5c-cc73-48a3-b3d1-abf426929958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:57.801951 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4cd5c-cc73-48a3-b3d1-abf426929958 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:57.802452 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4cd5c-cc73-48a3-b3d1-abf426929958 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:57.802937 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4cd5c-cc73-48a3-b3d1-abf426929958 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:57.858460 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:57.884990 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a4cd5c-cc73-48a3-b3d1-abf426929958 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:57.886869 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a4cd5c-cc73-48a3-b3d1-abf426929958 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:57.920572 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e1b43-bcb6-4143-a47f-291f859c5656 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:57.979532 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c5582b-2b89-4de8-8a91-b8a8d55317df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:57.980185 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5582b-2b89-4de8-8a91-b8a8d55317df None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:57.980468 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5582b-2b89-4de8-8a91-b8a8d55317df None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:57.980742 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5582b-2b89-4de8-8a91-b8a8d55317df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:58.009901 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 411/849] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Sep 18 00:43:57 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 18 00:43:58.011010 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e1d4a4-73b3-4cdc-9762-da3bcc33e8f0 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:58.011394 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e1d4a4-73b3-4cdc-9762-da3bcc33e8f0 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:58.011769 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e1d4a4-73b3-4cdc-9762-da3bcc33e8f0 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:58.013475 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 412/850] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:43:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:43:58.018818 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e1d4a4-73b3-4cdc-9762-da3bcc33e8f0 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:58.065471 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:58.081778 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c5582b-2b89-4de8-8a91-b8a8d55317df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:58.083249 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c5582b-2b89-4de8-8a91-b8a8d55317df None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:58.148543 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:58.183951 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e1d4a4-73b3-4cdc-9762-da3bcc33e8f0 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:58.194233 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 439/851] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Sep 18 00:43:57 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 18 00:43:58.200572 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f04f5-54fb-4f13-bd64-af0cdb2cff23 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:58.200862 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f04f5-54fb-4f13-bd64-af0cdb2cff23 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:58.201143 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f04f5-54fb-4f13-bd64-af0cdb2cff23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:58.221343 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-c15f04f5-54fb-4f13-bd64-af0cdb2cff23 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:43:58.222561 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-c15f04f5-54fb-4f13-bd64-af0cdb2cff23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:43:58.247428 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8320e501-5b98-477d-bcb9-cfddc0948c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:58.248686 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320e501-5b98-477d-bcb9-cfddc0948c68 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:58.249195 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320e501-5b98-477d-bcb9-cfddc0948c68 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:58.249681 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320e501-5b98-477d-bcb9-cfddc0948c68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:58.270829 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8320e501-5b98-477d-bcb9-cfddc0948c68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:58.273052 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8320e501-5b98-477d-bcb9-cfddc0948c68 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:58.290596 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-8320e501-5b98-477d-bcb9-cfddc0948c68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:58.290596 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:58.290596 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:58.290596 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:58.290596 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:58.290596 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:58.290596 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:58.290596 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:58.290596 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:58.290596 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:58.290596 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:58.290596 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:58.290596 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:43:58.290596 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:43:58.290596 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:43:58.290596 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:43:58.292589 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:58.292589 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:58.292589 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:58.292589 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:58.292589 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:58.292589 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:58.292589 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:58.292589 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:58.292589 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:58.292589 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:58.292589 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:58.292589 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:58.292589 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:58.292589 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:58.292589 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:58.292589 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:58.292589 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:43:58.294265 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:43:58.294265 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:58.294265 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:58.294265 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 413/852] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:43:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:58.294265 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8320e501-5b98-477d-bcb9-cfddc0948c68 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:58.311418 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 440/853] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:43:58 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 00:43:58.311418 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f04f5-54fb-4f13-bd64-af0cdb2cff23 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:58.335289 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:58.435342 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f04f5-54fb-4f13-bd64-af0cdb2cff23 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:58.441287 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8320e501-5b98-477d-bcb9-cfddc0948c68 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:58.482061 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfd324c-789a-4e6d-86ac-61cde105f3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:58.482688 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd324c-789a-4e6d-86ac-61cde105f3d3 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:58.482982 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd324c-789a-4e6d-86ac-61cde105f3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:58.483455 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd324c-789a-4e6d-86ac-61cde105f3d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:58.484138 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfd324c-789a-4e6d-86ac-61cde105f3d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:58.484442 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfd324c-789a-4e6d-86ac-61cde105f3d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:58.484792 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:58.486939 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfd324c-789a-4e6d-86ac-61cde105f3d3 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:58.494552 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df4e9d-b471-4c2f-ae51-4e8df6d67dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:58.496247 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df4e9d-b471-4c2f-ae51-4e8df6d67dd6 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:58.496831 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df4e9d-b471-4c2f-ae51-4e8df6d67dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:58.497884 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df4e9d-b471-4c2f-ae51-4e8df6d67dd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:58.500846 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 441/854] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:43:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:58.506536 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfd324c-789a-4e6d-86ac-61cde105f3d3 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:58.514448 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01df4e9d-b471-4c2f-ae51-4e8df6d67dd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:58.516338 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01df4e9d-b471-4c2f-ae51-4e8df6d67dd6 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:58.538131 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-01df4e9d-b471-4c2f-ae51-4e8df6d67dd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:58.538131 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:58.538131 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:58.538131 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:58.538131 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:58.538131 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:58.538131 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:58.538131 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:58.538131 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:58.538131 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:58.538131 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:58.538131 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:58.538131 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:43:58.538131 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:43:58.538131 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:43:58.538131 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:43:58.539318 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:58.539318 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:58.539318 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:58.539318 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:58.539318 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:58.539318 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:58.539318 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:58.539318 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:58.539318 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:58.539318 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:58.539318 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:58.539318 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:58.539318 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:58.539318 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:58.539318 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:58.539318 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:58.539318 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:43:58.540408 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:43:58.540408 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:43:58.540408 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:58.542551 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 414/855] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:43:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:58.553980 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df4e9d-b471-4c2f-ae51-4e8df6d67dd6 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:58.615329 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:58.644890 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfd324c-789a-4e6d-86ac-61cde105f3d3 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:58.686515 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df4e9d-b471-4c2f-ae51-4e8df6d67dd6 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:58.690691 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7bc116-cc57-4ef9-a1a9-2aab54a6fb3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:58.691632 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7bc116-cc57-4ef9-a1a9-2aab54a6fb3b None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:58.692179 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7bc116-cc57-4ef9-a1a9-2aab54a6fb3b None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:58.692660 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7bc116-cc57-4ef9-a1a9-2aab54a6fb3b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:58.701202 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7bc116-cc57-4ef9-a1a9-2aab54a6fb3b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:58.703358 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7bc116-cc57-4ef9-a1a9-2aab54a6fb3b None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:58.723555 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-cf7bc116-cc57-4ef9-a1a9-2aab54a6fb3b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:43:58.723555 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:58.723555 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:58.723555 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:58.723555 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:58.723555 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:58.723555 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:58.723555 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:58.723555 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:58.723555 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:58.723555 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:58.723555 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:58.723555 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 00:43:58.723555 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 00:43:58.723555 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 00:43:58.724532 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 00:43:58.724532 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:58.724532 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:58.724532 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:58.724532 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:58.724532 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:58.724532 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:58.724532 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:58.724532 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:58.724532 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:58.724532 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:58.724532 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:58.724532 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:58.724532 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:58.724532 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:58.724532 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:58.724532 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:58.725414 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 00:43:58.725414 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 00:43:58.725414 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 00:43:58.725414 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 00:43:58.725414 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 00:43:58.725414 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 00:43:58.725414 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:43:58.725414 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:43:58.728450 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 442/856] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Sep 18 00:43:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:58.734512 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7bc116-cc57-4ef9-a1a9-2aab54a6fb3b None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:58.736914 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33418f47-7ab8-46be-a968-d4f587346386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:58.737669 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33418f47-7ab8-46be-a968-d4f587346386 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:58.737959 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33418f47-7ab8-46be-a968-d4f587346386 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:58.738239 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33418f47-7ab8-46be-a968-d4f587346386 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:58.739020 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33418f47-7ab8-46be-a968-d4f587346386 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:58.739339 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33418f47-7ab8-46be-a968-d4f587346386 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:58.740885 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33418f47-7ab8-46be-a968-d4f587346386 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:58.755337 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 415/857] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:43:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:58.763235 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33418f47-7ab8-46be-a968-d4f587346386 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:58.816831 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:58.884008 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33418f47-7ab8-46be-a968-d4f587346386 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:58.904207 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7bc116-cc57-4ef9-a1a9-2aab54a6fb3b None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:58.926474 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ef600-7314-4642-b9db-2d90c64c6fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:58.927322 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ef600-7314-4642-b9db-2d90c64c6fa9 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:58.927602 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ef600-7314-4642-b9db-2d90c64c6fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:58.927874 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ef600-7314-4642-b9db-2d90c64c6fa9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:58.935443 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ef600-7314-4642-b9db-2d90c64c6fa9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:58.937088 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ef600-7314-4642-b9db-2d90c64c6fa9 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:58.949006 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-066ef600-7314-4642-b9db-2d90c64c6fa9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:43:58.949006 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:58.949006 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:58.949006 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:58.949006 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:58.949006 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:58.949006 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:58.949006 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:58.949006 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:58.949006 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:58.949006 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:58.949006 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:58.949006 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 00:43:58.949006 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 00:43:58.949006 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 00:43:58.949944 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 00:43:58.949944 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:58.949944 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:58.949944 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:58.949944 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:58.949944 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:58.949944 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:58.949944 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:58.949944 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:58.949944 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:58.949944 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:58.949944 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:58.949944 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:58.949944 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:58.949944 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:58.949944 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:58.949944 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:58.950808 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 00:43:58.950808 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 00:43:58.950808 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 00:43:58.950808 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 00:43:58.950808 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 00:43:58.950808 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 00:43:58.950808 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:43:58.950808 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:58.950808 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 416/858] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Sep 18 00:43:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 00:43:58.951863 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ef600-7314-4642-b9db-2d90c64c6fa9 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:58.964468 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679ae6e2-65d4-431f-8f6f-8979de060283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:58.965090 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ae6e2-65d4-431f-8f6f-8979de060283 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:58.965371 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ae6e2-65d4-431f-8f6f-8979de060283 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:58.965645 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ae6e2-65d4-431f-8f6f-8979de060283 None admin] PATH_INFO: `/v3/projects` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:58.966611 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679ae6e2-65d4-431f-8f6f-8979de060283 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:58.966611 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679ae6e2-65d4-431f-8f6f-8979de060283 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:58.968118 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679ae6e2-65d4-431f-8f6f-8979de060283 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:58.972535 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:58.997283 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 443/859] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Sep 18 00:43:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:58.997283 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679ae6e2-65d4-431f-8f6f-8979de060283 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:59.074859 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ef600-7314-4642-b9db-2d90c64c6fa9 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:59.077362 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:59.113151 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb4138c-fc6d-495d-987b-fd05d09e790f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:59.113813 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4138c-fc6d-495d-987b-fd05d09e790f None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:59.114077 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4138c-fc6d-495d-987b-fd05d09e790f None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:59.114349 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4138c-fc6d-495d-987b-fd05d09e790f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:59.114937 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb4138c-fc6d-495d-987b-fd05d09e790f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:59.116390 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb4138c-fc6d-495d-987b-fd05d09e790f None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:59.128844 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-5bb4138c-fc6d-495d-987b-fd05d09e790f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 18 00:43:59.128844 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:59.128844 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 18 00:43:59.128844 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 18 00:43:59.128844 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 18 00:43:59.128844 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 18 00:43:59.128844 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 18 00:43:59.128844 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 00:43:59.128844 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 18 00:43:59.128844 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:59.128844 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 18 00:43:59.128844 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:59.128844 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:43:59.128844 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:43:59.128844 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:43:59.128844 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:43:59.128844 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:43:59.129863 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:43:59.129863 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:43:59.129863 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:43:59.129863 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:43:59.129863 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:43:59.129863 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:43:59.129863 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 18 00:43:59.129863 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 18 00:43:59.129863 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 18 00:43:59.129863 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 18 00:43:59.129863 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:43:59.129863 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:43:59.129863 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:43:59.129863 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:43:59.129863 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:43:59.129863 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:43:59.130681 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:43:59.130681 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:43:59.130681 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:43:59.130681 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:43:59.130681 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:43:59.130681 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:43:59.130681 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:43:59.130681 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:43:59.130681 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:43:59.130681 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:43:59.130681 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 18 00:43:59.130681 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 00:43:59.130681 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 18 00:43:59.130681 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:43:59.134889 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 417/860] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Sep 18 00:43:58 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:43:59.134889 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb4138c-fc6d-495d-987b-fd05d09e790f None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:59.176593 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679ae6e2-65d4-431f-8f6f-8979de060283 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:59.214870 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b2c46-30ae-40d9-b2ef-d2db08480b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:59.215387 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b2c46-30ae-40d9-b2ef-d2db08480b4c None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:59.215790 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b2c46-30ae-40d9-b2ef-d2db08480b4c None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:59.216004 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b2c46-30ae-40d9-b2ef-d2db08480b4c None admin] PATH_INFO: `/v3/projects` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:59.216659 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65b2c46-30ae-40d9-b2ef-d2db08480b4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:59.216961 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65b2c46-30ae-40d9-b2ef-d2db08480b4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:59.218411 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65b2c46-30ae-40d9-b2ef-d2db08480b4c None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:59.239938 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 444/861] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Sep 18 00:43:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:59.239938 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b2c46-30ae-40d9-b2ef-d2db08480b4c None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:59.278077 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb4138c-fc6d-495d-987b-fd05d09e790f None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:59.300701 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:59.329426 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e50c2-cce1-4823-bdbe-9c1d76ee0d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:59.330043 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e50c2-cce1-4823-bdbe-9c1d76ee0d67 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:59.330323 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e50c2-cce1-4823-bdbe-9c1d76ee0d67 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:59.330599 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e50c2-cce1-4823-bdbe-9c1d76ee0d67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:59.331343 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054e50c2-cce1-4823-bdbe-9c1d76ee0d67 None admin] RBAC: Adding query filter params (role.id=591d4711dc204cf98003c8b7d7558506, scope.project.id=52ebde8fa3f84ede9ef575f7c0780798, user.id=d0f16f1f2cb8475d9d5c752f56c4b74d) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:59.331658 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054e50c2-cce1-4823-bdbe-9c1d76ee0d67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:59.333173 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054e50c2-cce1-4823-bdbe-9c1d76ee0d67 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:59.340143 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 418/862] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Sep 18 00:43:59 2022] GET /identity/v3/role_assignments?user.id=d0f16f1f2cb8475d9d5c752f56c4b74d&scope.project.id=52ebde8fa3f84ede9ef575f7c0780798&role.id=591d4711dc204cf98003c8b7d7558506 => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:59.341001 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e50c2-cce1-4823-bdbe-9c1d76ee0d67 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:59.367452 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b2c46-30ae-40d9-b2ef-d2db08480b4c None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:59.386979 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:59.427548 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1954c5-9de9-42ad-89c4-50baeafad923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:59.428632 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1954c5-9de9-42ad-89c4-50baeafad923 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:59.428916 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1954c5-9de9-42ad-89c4-50baeafad923 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:59.429189 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1954c5-9de9-42ad-89c4-50baeafad923 None admin] PATH_INFO: `/v3/services` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:59.429840 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1954c5-9de9-42ad-89c4-50baeafad923 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:59.430146 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1954c5-9de9-42ad-89c4-50baeafad923 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:59.431557 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1954c5-9de9-42ad-89c4-50baeafad923 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:59.442482 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 445/863] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Sep 18 00:43:59 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:59.444023 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1954c5-9de9-42ad-89c4-50baeafad923 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:43:59.500112 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e50c2-cce1-4823-bdbe-9c1d76ee0d67 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:59.559310 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0fd494-74b5-4634-8003-eedc12384fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:59.560431 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0fd494-74b5-4634-8003-eedc12384fd3 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:59.560939 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0fd494-74b5-4634-8003-eedc12384fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:59.561425 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0fd494-74b5-4634-8003-eedc12384fd3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:59.562411 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0fd494-74b5-4634-8003-eedc12384fd3 None admin] RBAC: Adding query filter params (role.id=5e91422b372b43749fe857ffd7bba774, scope.project.id=52ebde8fa3f84ede9ef575f7c0780798, user.id=9afbb5a9f364495ca55089dd6ddd7934) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:59.562957 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0fd494-74b5-4634-8003-eedc12384fd3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:59.565277 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0fd494-74b5-4634-8003-eedc12384fd3 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:59.580206 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 419/864] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Sep 18 00:43:59 2022] GET /identity/v3/role_assignments?user.id=9afbb5a9f364495ca55089dd6ddd7934&scope.project.id=52ebde8fa3f84ede9ef575f7c0780798&role.id=5e91422b372b43749fe857ffd7bba774 => generated 608 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:43:59.620298 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1954c5-9de9-42ad-89c4-50baeafad923 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:43:59.661988 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:43:59.695581 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277510c4-5ccd-42be-b8da-6bcede98e1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:43:59.697318 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277510c4-5ccd-42be-b8da-6bcede98e1c4 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:43:59.697962 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277510c4-5ccd-42be-b8da-6bcede98e1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:43:59.698734 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277510c4-5ccd-42be-b8da-6bcede98e1c4 None admin] PATH_INFO: `/v3/services` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:43:59.700469 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277510c4-5ccd-42be-b8da-6bcede98e1c4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:43:59.701392 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277510c4-5ccd-42be-b8da-6bcede98e1c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:43:59.705099 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277510c4-5ccd-42be-b8da-6bcede98e1c4 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:43:59.720096 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 446/865] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Sep 18 00:43:59 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:00.029989 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4305fa-b512-4935-a0f3-724974aaf0d7 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:00.030780 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4305fa-b512-4935-a0f3-724974aaf0d7 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:00.031154 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4305fa-b512-4935-a0f3-724974aaf0d7 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:00.034527 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 420/866] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:44:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:44:00.044296 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9a66e-aafe-49c3-8275-83ed3cf7ae06 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:00.044892 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9a66e-aafe-49c3-8275-83ed3cf7ae06 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:00.045283 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9a66e-aafe-49c3-8275-83ed3cf7ae06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:00.077050 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-45c9a66e-aafe-49c3-8275-83ed3cf7ae06 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:44:00.078314 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-45c9a66e-aafe-49c3-8275-83ed3cf7ae06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:44:00.198760 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 447/867] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:44:00 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 18 00:44:00.703060 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4305fa-b512-4935-a0f3-724974aaf0d7 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:00.825554 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:00.833642 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4305fa-b512-4935-a0f3-724974aaf0d7 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:00.872834 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8753f3-4f29-4473-b98a-448dd610a018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:00.873501 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8753f3-4f29-4473-b98a-448dd610a018 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:00.873788 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8753f3-4f29-4473-b98a-448dd610a018 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:00.874065 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8753f3-4f29-4473-b98a-448dd610a018 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:00.874664 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8753f3-4f29-4473-b98a-448dd610a018 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:00.876214 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8753f3-4f29-4473-b98a-448dd610a018 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:00.885984 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-ef8753f3-4f29-4473-b98a-448dd610a018 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 18 00:44:00.885984 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:00.885984 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 18 00:44:00.885984 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 18 00:44:00.885984 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 18 00:44:00.885984 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 18 00:44:00.885984 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 18 00:44:00.885984 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 00:44:00.885984 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 18 00:44:00.885984 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:44:00.885984 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 18 00:44:00.885984 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:44:00.885984 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:00.885984 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:44:00.885984 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:44:00.885984 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:44:00.886979 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:44:00.886979 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:44:00.886979 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:44:00.886979 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:44:00.886979 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:44:00.886979 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:44:00.886979 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:44:00.886979 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 18 00:44:00.886979 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 18 00:44:00.886979 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 18 00:44:00.886979 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 18 00:44:00.886979 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:44:00.886979 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:44:00.886979 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:44:00.886979 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:44:00.886979 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:44:00.886979 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:44:00.888106 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:44:00.888106 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:44:00.888106 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:44:00.888106 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:44:00.888106 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:44:00.888106 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:44:00.888106 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:44:00.888106 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:44:00.888106 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:44:00.888106 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:44:00.888106 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 18 00:44:00.888106 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 00:44:00.888106 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 18 00:44:00.888106 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:44:00.888106 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 421/868] 10.222.0.15 () {56 vars in 1132 bytes} [Sun Sep 18 00:44:00 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:44:00.896618 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c9a66e-aafe-49c3-8275-83ed3cf7ae06 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:01.069312 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c9a66e-aafe-49c3-8275-83ed3cf7ae06 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:01.094768 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:01.123460 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f75564b-1840-44c1-926a-24a70e190bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:01.124111 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f75564b-1840-44c1-926a-24a70e190bec None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:01.124394 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f75564b-1840-44c1-926a-24a70e190bec None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:01.124670 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f75564b-1840-44c1-926a-24a70e190bec None admin] PATH_INFO: `/v3/services` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:01.125311 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f75564b-1840-44c1-926a-24a70e190bec None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:01.125651 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f75564b-1840-44c1-926a-24a70e190bec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:01.127139 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f75564b-1840-44c1-926a-24a70e190bec None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:01.132426 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 448/869] 10.222.0.15 () {56 vars in 1126 bytes} [Sun Sep 18 00:44:00 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:01.141033 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8753f3-4f29-4473-b98a-448dd610a018 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:01.290516 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8753f3-4f29-4473-b98a-448dd610a018 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:01.329441 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe0070f-5f78-41d7-bc59-9fa325a1fdc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:01.330070 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe0070f-5f78-41d7-bc59-9fa325a1fdc2 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:01.330419 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe0070f-5f78-41d7-bc59-9fa325a1fdc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:01.330706 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe0070f-5f78-41d7-bc59-9fa325a1fdc2 None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:01.331346 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe0070f-5f78-41d7-bc59-9fa325a1fdc2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:01.331654 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe0070f-5f78-41d7-bc59-9fa325a1fdc2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:01.333135 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe0070f-5f78-41d7-bc59-9fa325a1fdc2 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:01.338642 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 422/870] 10.222.0.15 () {56 vars in 1126 bytes} [Sun Sep 18 00:44:01 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:01.960959 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebb2b3-d9fd-4e56-9235-965b9c82b378 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:01.961710 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebb2b3-d9fd-4e56-9235-965b9c82b378 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:01.962205 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebb2b3-d9fd-4e56-9235-965b9c82b378 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:01.964262 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 449/871] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:44:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:44:01.970307 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc3b8c0-e99d-4c20-89c8-24fbda3d6f78 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:01.970919 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc3b8c0-e99d-4c20-89c8-24fbda3d6f78 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:01.971399 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc3b8c0-e99d-4c20-89c8-24fbda3d6f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:01.982514 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bccfed-8573-4302-8395-9b19f6550651 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:01.982850 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bccfed-8573-4302-8395-9b19f6550651 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:01.983078 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bccfed-8573-4302-8395-9b19f6550651 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:01.984921 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 450/872] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 18 00:44:01.993978 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c4780-b19e-4702-a2fc-24206f821572 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:01.994456 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c4780-b19e-4702-a2fc-24206f821572 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:01.994847 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c4780-b19e-4702-a2fc-24206f821572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:01.998188 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-6dc3b8c0-e99d-4c20-89c8-24fbda3d6f78 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:44:01.999597 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-6dc3b8c0-e99d-4c20-89c8-24fbda3d6f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:44:02.022624 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-7d9c4780-b19e-4702-a2fc-24206f821572 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:44:02.024490 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-7d9c4780-b19e-4702-a2fc-24206f821572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:44:02.025346 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:02.095419 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 423/873] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:44:01 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 00:44:02.136237 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 451/874] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:44:01 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 18 00:44:02.146170 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a911f-8cab-431a-a851-67bfc34d65bb None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:02.146681 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a911f-8cab-431a-a851-67bfc34d65bb None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:02.146891 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a911f-8cab-431a-a851-67bfc34d65bb None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:02.148470 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 424/875] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:44:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:44:02.154247 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67c959-67a2-42cb-ba6a-0aa5d721da4b None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:02.154752 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67c959-67a2-42cb-ba6a-0aa5d721da4b None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:02.155203 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67c959-67a2-42cb-ba6a-0aa5d721da4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:02.175249 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-0d67c959-67a2-42cb-ba6a-0aa5d721da4b None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:44:02.176512 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-0d67c959-67a2-42cb-ba6a-0aa5d721da4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:44:02.280622 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 452/876] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:44:02 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 00:44:02.474493 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a911f-8cab-431a-a851-67bfc34d65bb None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:02.570276 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d67c959-67a2-42cb-ba6a-0aa5d721da4b None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:02.648168 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:02.694452 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a911f-8cab-431a-a851-67bfc34d65bb None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:02.732125 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d67c959-67a2-42cb-ba6a-0aa5d721da4b None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:02.761059 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaa6e96-2bb7-4c61-8aa7-a6a084fe64b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:02.762104 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa6e96-2bb7-4c61-8aa7-a6a084fe64b7 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:02.762559 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa6e96-2bb7-4c61-8aa7-a6a084fe64b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:02.763021 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa6e96-2bb7-4c61-8aa7-a6a084fe64b7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:02.780693 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaa6e96-2bb7-4c61-8aa7-a6a084fe64b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:44:02.789183 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-8eaa6e96-2bb7-4c61-8aa7-a6a084fe64b7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 18 00:44:02.789183 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:02.789183 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:44:02.789183 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:44:02.789183 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:44:02.789183 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:44:02.789183 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:44:02.789183 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:44:02.789183 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:44:02.789183 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:44:02.789183 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:44:02.789183 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:44:02.789183 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:44:02.789183 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:44:02.789183 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:44:02.789183 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:44:02.791319 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:44:02.791319 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:44:02.791319 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:44:02.791319 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:44:02.791319 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:44:02.791319 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:44:02.791319 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:44:02.791319 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:44:02.791319 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:44:02.791319 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:44:02.791319 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:44:02.791319 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:44:02.791319 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:44:02.791319 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:44:02.791319 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:44:02.791319 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:44:02.793560 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:44:02.793560 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:44:02.793560 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:44:02.793560 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:44:02.793560 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:44:02.793560 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:44:02.793560 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:44:02.793560 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:44:02.793560 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:44:02.793560 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:44:02.793560 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 18 00:44:02.793560 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:44:02.793560 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 425/877] 10.222.0.15 () {56 vars in 1120 bytes} [Sun Sep 18 00:44:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:44:02.793560 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaa6e96-2bb7-4c61-8aa7-a6a084fe64b7 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:02.805803 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfd9871-dad3-41a0-9d3c-6649d4f42b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:02.807122 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd9871-dad3-41a0-9d3c-6649d4f42b07 None admin] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:02.807573 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd9871-dad3-41a0-9d3c-6649d4f42b07 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:02.808050 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd9871-dad3-41a0-9d3c-6649d4f42b07 None admin] PATH_INFO: `/v3/services` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:02.809820 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfd9871-dad3-41a0-9d3c-6649d4f42b07 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:02.812287 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfd9871-dad3-41a0-9d3c-6649d4f42b07 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:02.822475 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:02.841261 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 453/878] 10.222.0.15 () {60 vars in 1141 bytes} [Sun Sep 18 00:44:02 2022] POST /identity/v3/services => generated 251 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 00:44:02.843065 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfd9871-dad3-41a0-9d3c-6649d4f42b07 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:02.964135 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaa6e96-2bb7-4c61-8aa7-a6a084fe64b7 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:03.034129 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a4cd6-04fa-41b7-b43c-d6119d5b5e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:03.035687 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a4cd6-04fa-41b7-b43c-d6119d5b5e01 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:03.036216 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a4cd6-04fa-41b7-b43c-d6119d5b5e01 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:03.036713 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a4cd6-04fa-41b7-b43c-d6119d5b5e01 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:03.038548 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4a4cd6-04fa-41b7-b43c-d6119d5b5e01 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:03.041482 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4a4cd6-04fa-41b7-b43c-d6119d5b5e01 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:03.066045 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:03.071324 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-ca4a4cd6-04fa-41b7-b43c-d6119d5b5e01 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 18 00:44:03.071324 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:03.071324 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 18 00:44:03.071324 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 18 00:44:03.071324 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 18 00:44:03.071324 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 18 00:44:03.071324 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 18 00:44:03.071324 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 00:44:03.071324 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 18 00:44:03.071324 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:44:03.071324 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 18 00:44:03.071324 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:44:03.071324 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:03.071324 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:44:03.071324 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:44:03.071324 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:44:03.071324 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:44:03.072701 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:44:03.072701 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:44:03.072701 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:44:03.072701 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:44:03.072701 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:44:03.072701 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:44:03.072701 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 18 00:44:03.072701 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 18 00:44:03.072701 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 18 00:44:03.072701 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 18 00:44:03.072701 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:44:03.072701 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:44:03.072701 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:44:03.072701 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:44:03.072701 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:44:03.072701 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:44:03.074027 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:44:03.074027 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:44:03.074027 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:44:03.074027 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:44:03.074027 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:44:03.074027 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:44:03.074027 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:44:03.074027 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:44:03.074027 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:44:03.074027 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:44:03.074027 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 18 00:44:03.074027 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 00:44:03.074027 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 18 00:44:03.074027 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:44:03.074027 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 426/879] 10.222.0.15 () {56 vars in 1126 bytes} [Sun Sep 18 00:44:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:44:03.077058 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfd9871-dad3-41a0-9d3c-6649d4f42b07 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:03.083684 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a4cd6-04fa-41b7-b43c-d6119d5b5e01 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:03.148964 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecf58c9-5697-49bf-9edd-8b13b3daaf3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:03.150259 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf58c9-5697-49bf-9edd-8b13b3daaf3e None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:03.150704 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf58c9-5697-49bf-9edd-8b13b3daaf3e None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:03.150973 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf58c9-5697-49bf-9edd-8b13b3daaf3e None admin] PATH_INFO: `/v3/roles` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:03.151660 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecf58c9-5697-49bf-9edd-8b13b3daaf3e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:03.152634 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecf58c9-5697-49bf-9edd-8b13b3daaf3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:03.154065 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecf58c9-5697-49bf-9edd-8b13b3daaf3e None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:03.165529 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 454/880] 10.222.0.15 () {56 vars in 1115 bytes} [Sun Sep 18 00:44:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:03.174750 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecf58c9-5697-49bf-9edd-8b13b3daaf3e None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:03.229372 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:03.290913 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a4cd6-04fa-41b7-b43c-d6119d5b5e01 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:03.369835 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecf58c9-5697-49bf-9edd-8b13b3daaf3e None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:03.370111 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ceec6-4e65-4efa-9ab1-793f476969ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:03.370819 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ceec6-4e65-4efa-9ab1-793f476969ee None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:03.371274 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ceec6-4e65-4efa-9ab1-793f476969ee None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:03.371562 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ceec6-4e65-4efa-9ab1-793f476969ee None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:03.372384 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ceec6-4e65-4efa-9ab1-793f476969ee None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:03.372858 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ceec6-4e65-4efa-9ab1-793f476969ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:03.374815 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ceec6-4e65-4efa-9ab1-793f476969ee None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:03.383957 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 427/881] 10.222.0.15 () {56 vars in 1122 bytes} [Sun Sep 18 00:44:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:03.395202 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ceec6-4e65-4efa-9ab1-793f476969ee None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:03.428876 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22cfccf-1e1d-40e5-924d-2ff63a28d8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:03.429783 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22cfccf-1e1d-40e5-924d-2ff63a28d8ef None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:03.430213 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22cfccf-1e1d-40e5-924d-2ff63a28d8ef None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:03.430658 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22cfccf-1e1d-40e5-924d-2ff63a28d8ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:03.443804 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22cfccf-1e1d-40e5-924d-2ff63a28d8ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:03.445716 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22cfccf-1e1d-40e5-924d-2ff63a28d8ef None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:03.463227 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-f22cfccf-1e1d-40e5-924d-2ff63a28d8ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:44:03.463227 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:03.463227 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:44:03.463227 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:44:03.463227 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:44:03.463227 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:44:03.463227 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:44:03.463227 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:44:03.463227 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:44:03.463227 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:44:03.463227 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:44:03.463227 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:44:03.463227 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:44:03.463227 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:44:03.463227 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:44:03.463227 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:44:03.464470 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:44:03.464470 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:44:03.464470 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:44:03.464470 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:44:03.464470 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:44:03.464470 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:44:03.464470 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:44:03.464470 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:44:03.464470 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:44:03.464470 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:44:03.464470 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:44:03.464470 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:44:03.464470 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:44:03.464470 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:44:03.464470 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:44:03.464470 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:44:03.464470 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:44:03.465342 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:44:03.465342 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:44:03.465342 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:44:03.477991 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 455/882] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:44:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 00:44:03.479711 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22cfccf-1e1d-40e5-924d-2ff63a28d8ef None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:03.498894 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:03.634609 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ceec6-4e65-4efa-9ab1-793f476969ee None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:03.636191 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22cfccf-1e1d-40e5-924d-2ff63a28d8ef None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:03.701360 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47afc64a-bf16-40d2-89f0-841fb8a30ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:03.702521 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47afc64a-bf16-40d2-89f0-841fb8a30ae1 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:03.702972 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47afc64a-bf16-40d2-89f0-841fb8a30ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:03.703422 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47afc64a-bf16-40d2-89f0-841fb8a30ae1 None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:03.704709 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47afc64a-bf16-40d2-89f0-841fb8a30ae1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:03.705257 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47afc64a-bf16-40d2-89f0-841fb8a30ae1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:03.707964 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47afc64a-bf16-40d2-89f0-841fb8a30ae1 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:03.718097 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 428/883] 10.222.0.15 () {56 vars in 1122 bytes} [Sun Sep 18 00:44:03 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:03.727409 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1378295e-3acd-46d8-b669-61ef2dd4074c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:03.728613 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378295e-3acd-46d8-b669-61ef2dd4074c None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:03.729207 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378295e-3acd-46d8-b669-61ef2dd4074c None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:03.729669 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378295e-3acd-46d8-b669-61ef2dd4074c None admin] PATH_INFO: `/v3/domains` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:03.731070 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1378295e-3acd-46d8-b669-61ef2dd4074c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:03.731605 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1378295e-3acd-46d8-b669-61ef2dd4074c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:03.734578 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1378295e-3acd-46d8-b669-61ef2dd4074c None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:03.762432 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 456/884] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:44:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:44:03.770025 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47afc64a-bf16-40d2-89f0-841fb8a30ae1 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:03.775220 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:03.879494 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398f03d-0183-40f0-a266-64fbb131f36e None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:03.879763 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398f03d-0183-40f0-a266-64fbb131f36e None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:03.880148 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398f03d-0183-40f0-a266-64fbb131f36e None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:03.881897 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 457/885] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:44:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:44:03.891829 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2fa4b-94bd-414e-b064-ad4694226c85 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:03.892109 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2fa4b-94bd-414e-b064-ad4694226c85 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:03.892417 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2fa4b-94bd-414e-b064-ad4694226c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:03.917807 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-cfd2fa4b-94bd-414e-b064-ad4694226c85 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:44:03.919292 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-cfd2fa4b-94bd-414e-b064-ad4694226c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:44:03.939021 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47afc64a-bf16-40d2-89f0-841fb8a30ae1 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:04.015939 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 458/886] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:44:03 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 18 00:44:04.016269 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170878a1-e0db-458b-a9d8-7152845a7074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:04.016269 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170878a1-e0db-458b-a9d8-7152845a7074 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:04.016269 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170878a1-e0db-458b-a9d8-7152845a7074 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:04.016269 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170878a1-e0db-458b-a9d8-7152845a7074 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:04.025075 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170878a1-e0db-458b-a9d8-7152845a7074 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:04.026554 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170878a1-e0db-458b-a9d8-7152845a7074 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:04.038899 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-170878a1-e0db-458b-a9d8-7152845a7074 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 18 00:44:04.038899 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:04.038899 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:44:04.038899 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:44:04.038899 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:44:04.038899 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:44:04.038899 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:44:04.038899 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:44:04.038899 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:44:04.038899 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:44:04.038899 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:44:04.038899 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:44:04.038899 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 00:44:04.038899 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 00:44:04.038899 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 00:44:04.038899 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 00:44:04.040716 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:44:04.040716 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:44:04.040716 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 00:44:04.040716 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:44:04.040716 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 00:44:04.040716 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:44:04.040716 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:44:04.040716 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:44:04.040716 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:44:04.040716 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:44:04.040716 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:44:04.040716 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:44:04.040716 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:44:04.040716 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:44:04.040716 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:44:04.040716 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:44:04.040716 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:44:04.040716 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:44:04.042698 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:44:04.042698 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:44:04.042698 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 00:44:04.042698 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 00:44:04.042698 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 00:44:04.042698 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 00:44:04.042698 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 00:44:04.042698 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 00:44:04.042698 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 18 00:44:04.042698 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:44:04.044508 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 429/887] 10.222.0.15 () {56 vars in 1117 bytes} [Sun Sep 18 00:44:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:44:04.048727 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2fa4b-94bd-414e-b064-ad4694226c85 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:04.058487 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:04.205362 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2fa4b-94bd-414e-b064-ad4694226c85 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:04.273253 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2de28d-428d-4e46-ac61-ad1a7d59c68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:04.274882 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2de28d-428d-4e46-ac61-ad1a7d59c68b None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:04.275657 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2de28d-428d-4e46-ac61-ad1a7d59c68b None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:04.276472 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2de28d-428d-4e46-ac61-ad1a7d59c68b None admin] PATH_INFO: `/v3/users` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:04.278112 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2de28d-428d-4e46-ac61-ad1a7d59c68b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:04.278990 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2de28d-428d-4e46-ac61-ad1a7d59c68b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:04.281559 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2de28d-428d-4e46-ac61-ad1a7d59c68b None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:04.317933 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 459/888] 10.222.0.15 () {56 vars in 1149 bytes} [Sun Sep 18 00:44:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:04.325696 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170878a1-e0db-458b-a9d8-7152845a7074 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:04.394129 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:04.411610 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2de28d-428d-4e46-ac61-ad1a7d59c68b None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:04.438972 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170878a1-e0db-458b-a9d8-7152845a7074 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:04.478499 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f9b129-3b5a-42bc-964c-8ab96081d9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:04.479164 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f9b129-3b5a-42bc-964c-8ab96081d9f4 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:04.479436 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f9b129-3b5a-42bc-964c-8ab96081d9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:04.479723 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f9b129-3b5a-42bc-964c-8ab96081d9f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:04.534988 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:04.566824 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f9b129-3b5a-42bc-964c-8ab96081d9f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:04.568543 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f9b129-3b5a-42bc-964c-8ab96081d9f4 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:04.614493 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2de28d-428d-4e46-ac61-ad1a7d59c68b None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:04.656404 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:04.683233 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39963cae-bed5-46e6-8197-ed8d45085c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:04.683929 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39963cae-bed5-46e6-8197-ed8d45085c27 None admin] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:04.684231 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39963cae-bed5-46e6-8197-ed8d45085c27 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:04.684509 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39963cae-bed5-46e6-8197-ed8d45085c27 None admin] PATH_INFO: `/v3/services` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:04.685212 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39963cae-bed5-46e6-8197-ed8d45085c27 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:04.687304 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39963cae-bed5-46e6-8197-ed8d45085c27 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:04.711930 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 460/889] 10.222.0.15 () {60 vars in 1141 bytes} [Sun Sep 18 00:44:04 2022] POST /identity/v3/services => generated 269 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 00:44:04.742304 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 430/890] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Sep 18 00:44:04 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 18 00:44:04.748153 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39963cae-bed5-46e6-8197-ed8d45085c27 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:04.907302 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39963cae-bed5-46e6-8197-ed8d45085c27 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:04.940239 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:04.977702 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eee0571-3f05-4e5a-af4c-fb0488d528d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:04.978724 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee0571-3f05-4e5a-af4c-fb0488d528d9 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:04.979166 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee0571-3f05-4e5a-af4c-fb0488d528d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:04.979595 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee0571-3f05-4e5a-af4c-fb0488d528d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:05.000063 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eee0571-3f05-4e5a-af4c-fb0488d528d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:05.003283 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eee0571-3f05-4e5a-af4c-fb0488d528d9 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:05.030807 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-4eee0571-3f05-4e5a-af4c-fb0488d528d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:44:05.030807 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:05.030807 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:44:05.030807 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:44:05.030807 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:44:05.030807 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:44:05.030807 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:44:05.030807 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:44:05.030807 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:44:05.030807 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:44:05.030807 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:44:05.030807 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:44:05.030807 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:44:05.030807 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:44:05.030807 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:44:05.030807 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:44:05.031950 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:44:05.031950 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:44:05.031950 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:44:05.031950 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:44:05.031950 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:44:05.031950 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:44:05.031950 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:44:05.031950 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:44:05.031950 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:44:05.031950 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:44:05.031950 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:44:05.031950 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:44:05.031950 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:44:05.031950 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:44:05.031950 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:44:05.031950 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:44:05.031950 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:44:05.032896 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:44:05.032896 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:44:05.032896 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:44:05.033605 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 461/891] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:44:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:44:05.039577 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f9b129-3b5a-42bc-964c-8ab96081d9f4 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:05.153959 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f9b129-3b5a-42bc-964c-8ab96081d9f4 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:05.193932 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f4ceea-aacd-426c-b71e-e2dc91e2a3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:05.194554 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4ceea-aacd-426c-b71e-e2dc91e2a3b6 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:05.194838 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4ceea-aacd-426c-b71e-e2dc91e2a3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:05.195115 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4ceea-aacd-426c-b71e-e2dc91e2a3b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:05.195764 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f4ceea-aacd-426c-b71e-e2dc91e2a3b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:05.196105 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f4ceea-aacd-426c-b71e-e2dc91e2a3b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:05.197597 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f4ceea-aacd-426c-b71e-e2dc91e2a3b6 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:05.211820 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 431/892] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:44:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:44:05.217337 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eee0571-3f05-4e5a-af4c-fb0488d528d9 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:05.401527 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eee0571-3f05-4e5a-af4c-fb0488d528d9 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:05.477231 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8685c5d-7011-44d0-a304-98c03ed0b35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:05.478329 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8685c5d-7011-44d0-a304-98c03ed0b35b None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:05.478817 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8685c5d-7011-44d0-a304-98c03ed0b35b None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:05.479301 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8685c5d-7011-44d0-a304-98c03ed0b35b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:05.492914 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8685c5d-7011-44d0-a304-98c03ed0b35b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:05.495874 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8685c5d-7011-44d0-a304-98c03ed0b35b None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:05.518165 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-e8685c5d-7011-44d0-a304-98c03ed0b35b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:44:05.518165 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:05.518165 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:44:05.518165 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:44:05.518165 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:44:05.518165 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:44:05.518165 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:44:05.518165 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:44:05.518165 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:44:05.518165 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:44:05.518165 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:44:05.518165 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:44:05.518165 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 00:44:05.518165 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 00:44:05.518165 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 00:44:05.519172 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 00:44:05.519172 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:44:05.519172 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:44:05.519172 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:44:05.519172 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:44:05.519172 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:44:05.519172 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:44:05.519172 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:44:05.519172 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:44:05.519172 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:44:05.519172 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:44:05.519172 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:44:05.519172 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:44:05.519172 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:44:05.519172 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:44:05.519172 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:44:05.519172 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:44:05.520120 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 00:44:05.520120 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 00:44:05.520120 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 00:44:05.520120 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 00:44:05.520120 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 00:44:05.520120 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 00:44:05.520120 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:44:05.520120 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:44:05.520816 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 462/893] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Sep 18 00:44:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:44:05.526491 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f4ceea-aacd-426c-b71e-e2dc91e2a3b6 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:05.556789 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:05.650658 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f4ceea-aacd-426c-b71e-e2dc91e2a3b6 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:05.691382 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa3e2eb-2dd0-443b-b115-46949bcf278b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:05.691942 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3e2eb-2dd0-443b-b115-46949bcf278b None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:05.692231 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3e2eb-2dd0-443b-b115-46949bcf278b None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:05.692509 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3e2eb-2dd0-443b-b115-46949bcf278b None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:05.693216 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa3e2eb-2dd0-443b-b115-46949bcf278b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:05.693526 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa3e2eb-2dd0-443b-b115-46949bcf278b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:05.695059 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa3e2eb-2dd0-443b-b115-46949bcf278b None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:05.709399 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 432/894] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Sep 18 00:44:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:05.715573 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8685c5d-7011-44d0-a304-98c03ed0b35b None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:05.748329 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:05.853137 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8685c5d-7011-44d0-a304-98c03ed0b35b None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:05.922794 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d464310a-b98a-4277-827a-a8cfc3bfa3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:05.923878 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464310a-b98a-4277-827a-a8cfc3bfa3ff None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:05.924389 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464310a-b98a-4277-827a-a8cfc3bfa3ff None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:05.924851 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464310a-b98a-4277-827a-a8cfc3bfa3ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:05.926281 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d464310a-b98a-4277-827a-a8cfc3bfa3ff None admin] RBAC: Adding query filter params (role.id=5e489759b2bc48d6b3895ed9d1f79f19, scope.project.id=52ebde8fa3f84ede9ef575f7c0780798, user.id=9afbb5a9f364495ca55089dd6ddd7934) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:05.926835 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d464310a-b98a-4277-827a-a8cfc3bfa3ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:05.929726 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d464310a-b98a-4277-827a-a8cfc3bfa3ff None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:05.942736 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 463/895] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Sep 18 00:44:05 2022] GET /identity/v3/role_assignments?user.id=9afbb5a9f364495ca55089dd6ddd7934&scope.project.id=52ebde8fa3f84ede9ef575f7c0780798&role.id=5e489759b2bc48d6b3895ed9d1f79f19 => generated 259 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:06.109030 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a5c93-3c12-4cda-a67a-ca4f19e0d64f None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:06.109389 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a5c93-3c12-4cda-a67a-ca4f19e0d64f None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:06.109594 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a5c93-3c12-4cda-a67a-ca4f19e0d64f None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:06.111872 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 433/896] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:44:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:44:06.121147 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e43ff4-0220-4755-aa4d-ddc1772c6808 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:06.121664 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e43ff4-0220-4755-aa4d-ddc1772c6808 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:06.122168 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e43ff4-0220-4755-aa4d-ddc1772c6808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:06.157321 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-f9e43ff4-0220-4755-aa4d-ddc1772c6808 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:44:06.159446 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-f9e43ff4-0220-4755-aa4d-ddc1772c6808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:44:06.247625 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 464/897] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:44:06 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 00:44:06.387613 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcdcac3-5047-405b-9e8d-a94620a0a420 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:06.388303 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcdcac3-5047-405b-9e8d-a94620a0a420 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:06.388805 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcdcac3-5047-405b-9e8d-a94620a0a420 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:06.390681 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 434/898] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:44:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:44:06.397343 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553cabf8-fa51-4b8b-8fc0-f6f2e901d3c8 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:06.397940 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553cabf8-fa51-4b8b-8fc0-f6f2e901d3c8 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:06.398434 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553cabf8-fa51-4b8b-8fc0-f6f2e901d3c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:06.419256 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-553cabf8-fa51-4b8b-8fc0-f6f2e901d3c8 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:44:06.420878 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-553cabf8-fa51-4b8b-8fc0-f6f2e901d3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:44:06.440091 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:06.504094 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 465/899] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:44:06 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 00:44:06.777103 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcdcac3-5047-405b-9e8d-a94620a0a420 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:06.788680 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553cabf8-fa51-4b8b-8fc0-f6f2e901d3c8 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:06.875996 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:06.899621 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcdcac3-5047-405b-9e8d-a94620a0a420 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:06.953701 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf1954-f0fa-4ed7-9f39-22f00953f10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:06.955526 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf1954-f0fa-4ed7-9f39-22f00953f10d None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:06.956151 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf1954-f0fa-4ed7-9f39-22f00953f10d None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:06.956635 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf1954-f0fa-4ed7-9f39-22f00953f10d None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:06.957811 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baf1954-f0fa-4ed7-9f39-22f00953f10d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:06.960391 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baf1954-f0fa-4ed7-9f39-22f00953f10d None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:06.970115 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553cabf8-fa51-4b8b-8fc0-f6f2e901d3c8 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:06.996483 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 435/900] 10.222.0.15 () {60 vars in 1141 bytes} [Sun Sep 18 00:44:06 2022] POST /identity/v3/services => generated 241 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 00:44:07.038263 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597cab94-ec18-45ea-962e-3ca2845599c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:07.039369 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597cab94-ec18-45ea-962e-3ca2845599c6 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:07.039944 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597cab94-ec18-45ea-962e-3ca2845599c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:07.040423 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597cab94-ec18-45ea-962e-3ca2845599c6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:07.041864 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597cab94-ec18-45ea-962e-3ca2845599c6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:07.044571 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597cab94-ec18-45ea-962e-3ca2845599c6 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:07.062569 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-597cab94-ec18-45ea-962e-3ca2845599c6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 18 00:44:07.062569 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:07.062569 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 18 00:44:07.062569 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 18 00:44:07.062569 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 18 00:44:07.062569 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 18 00:44:07.062569 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 18 00:44:07.062569 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 00:44:07.062569 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 18 00:44:07.062569 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:44:07.062569 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 18 00:44:07.062569 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:44:07.062569 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:07.062569 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:44:07.062569 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:44:07.062569 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:44:07.062569 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:44:07.064235 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:44:07.064235 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:44:07.064235 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:44:07.064235 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:44:07.064235 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:44:07.064235 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:44:07.064235 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 18 00:44:07.064235 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 18 00:44:07.064235 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 18 00:44:07.064235 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 18 00:44:07.064235 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:44:07.064235 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:44:07.064235 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:44:07.064235 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:44:07.064235 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:44:07.064235 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:44:07.065068 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:44:07.065068 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:44:07.065068 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:44:07.065068 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:44:07.065068 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:44:07.065068 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:44:07.065068 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:44:07.065068 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:44:07.065068 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:44:07.065068 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:44:07.065068 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 18 00:44:07.065068 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 00:44:07.065068 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 18 00:44:07.065068 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:44:07.066532 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 466/901] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Sep 18 00:44:06 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:44:07.076397 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf1954-f0fa-4ed7-9f39-22f00953f10d None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:07.270318 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf1954-f0fa-4ed7-9f39-22f00953f10d None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:07.317867 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51741c3b-51dd-4fb5-a91d-bd80704421a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:07.318431 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51741c3b-51dd-4fb5-a91d-bd80704421a5 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:07.318706 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51741c3b-51dd-4fb5-a91d-bd80704421a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:07.318982 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51741c3b-51dd-4fb5-a91d-bd80704421a5 None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:07.319638 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51741c3b-51dd-4fb5-a91d-bd80704421a5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:07.319966 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51741c3b-51dd-4fb5-a91d-bd80704421a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:07.321369 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51741c3b-51dd-4fb5-a91d-bd80704421a5 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:07.327527 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 436/902] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Sep 18 00:44:07 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:07.337332 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597cab94-ec18-45ea-962e-3ca2845599c6 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:07.360570 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:07.463345 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597cab94-ec18-45ea-962e-3ca2845599c6 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:07.502678 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e33fa2-e4ba-4435-8ad8-a4b2771201a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:07.503314 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e33fa2-e4ba-4435-8ad8-a4b2771201a5 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:07.503605 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e33fa2-e4ba-4435-8ad8-a4b2771201a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:07.503871 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e33fa2-e4ba-4435-8ad8-a4b2771201a5 None admin] PATH_INFO: `/v3/services` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:07.504568 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e33fa2-e4ba-4435-8ad8-a4b2771201a5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:07.504873 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e33fa2-e4ba-4435-8ad8-a4b2771201a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:07.506274 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e33fa2-e4ba-4435-8ad8-a4b2771201a5 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:07.512586 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 467/903] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Sep 18 00:44:07 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:07.521667 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51741c3b-51dd-4fb5-a91d-bd80704421a5 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:07.538422 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:07.714737 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51741c3b-51dd-4fb5-a91d-bd80704421a5 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:07.779247 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0c4073-7b37-429b-b04b-74257575f9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:07.780342 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c4073-7b37-429b-b04b-74257575f9e2 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:07.780972 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c4073-7b37-429b-b04b-74257575f9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:07.781470 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c4073-7b37-429b-b04b-74257575f9e2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:07.783340 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0c4073-7b37-429b-b04b-74257575f9e2 None admin] RBAC: Adding query filter params (interface=public, service_id=3260f91802114e7f9d512de2c067696b, region_id=RegionOne) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:07.783929 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0c4073-7b37-429b-b04b-74257575f9e2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:07.786727 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0c4073-7b37-429b-b04b-74257575f9e2 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:07.797824 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 437/904] 10.222.0.15 () {56 vars in 1251 bytes} [Sun Sep 18 00:44:07 2022] GET /identity/v3/endpoints?service_id=3260f91802114e7f9d512de2c067696b&interface=public®ion_id=RegionOne => generated 194 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:07.803584 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e33fa2-e4ba-4435-8ad8-a4b2771201a5 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:07.901467 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:07.928557 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e33fa2-e4ba-4435-8ad8-a4b2771201a5 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:07.967315 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d6dd8a-4e90-4975-94d3-31704aec0e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:07.968350 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6dd8a-4e90-4975-94d3-31704aec0e8a None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:07.968850 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6dd8a-4e90-4975-94d3-31704aec0e8a None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:07.969912 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6dd8a-4e90-4975-94d3-31704aec0e8a None admin] PATH_INFO: `/v3/services` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:07.970738 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d6dd8a-4e90-4975-94d3-31704aec0e8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:07.972418 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d6dd8a-4e90-4975-94d3-31704aec0e8a None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:07.979742 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 468/905] 10.222.0.15 () {56 vars in 1087 bytes} [Sun Sep 18 00:44:07 2022] GET /identity/v3/services => generated 1497 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 00:44:08.137806 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e824e-0bfc-460d-a120-f3971d825d8e None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:08.138182 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e824e-0bfc-460d-a120-f3971d825d8e None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:08.138371 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e824e-0bfc-460d-a120-f3971d825d8e None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:08.140355 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 438/906] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:44:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:44:08.146970 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8b6d1-3211-4712-9bc2-920da274dcef None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:08.147310 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8b6d1-3211-4712-9bc2-920da274dcef None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:08.147543 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8b6d1-3211-4712-9bc2-920da274dcef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:08.174434 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-e4f8b6d1-3211-4712-9bc2-920da274dcef None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:44:08.176198 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-e4f8b6d1-3211-4712-9bc2-920da274dcef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:44:08.261202 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 469/907] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:44:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 00:44:08.740786 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e824e-0bfc-460d-a120-f3971d825d8e None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:08.743374 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ca708-f856-48a0-984a-4c19262b76b3 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:08.744063 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ca708-f856-48a0-984a-4c19262b76b3 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:08.744404 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ca708-f856-48a0-984a-4c19262b76b3 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:08.747454 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 470/908] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:44:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:44:08.757610 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc5c72-8ec6-441b-be23-bd09c5928db6 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:08.758094 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc5c72-8ec6-441b-be23-bd09c5928db6 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:08.758575 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc5c72-8ec6-441b-be23-bd09c5928db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:08.789264 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-48bc5c72-8ec6-441b-be23-bd09c5928db6 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:44:08.791232 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-48bc5c72-8ec6-441b-be23-bd09c5928db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:44:08.856477 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:08.898202 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e824e-0bfc-460d-a120-f3971d825d8e None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:08.913156 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:08.924318 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 471/909] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:44:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 18 00:44:08.945798 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60874c6e-ed30-4e8a-becf-f83ccabbd494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:08.947053 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60874c6e-ed30-4e8a-becf-f83ccabbd494 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:08.947658 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60874c6e-ed30-4e8a-becf-f83ccabbd494 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:08.948173 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60874c6e-ed30-4e8a-becf-f83ccabbd494 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:08.949219 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60874c6e-ed30-4e8a-becf-f83ccabbd494 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:08.951221 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60874c6e-ed30-4e8a-becf-f83ccabbd494 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:08.962152 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-60874c6e-ed30-4e8a-becf-f83ccabbd494 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 18 00:44:08.962152 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:08.962152 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 18 00:44:08.962152 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 18 00:44:08.962152 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 18 00:44:08.962152 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 18 00:44:08.962152 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 18 00:44:08.962152 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 00:44:08.962152 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 18 00:44:08.962152 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:44:08.962152 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 18 00:44:08.962152 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:44:08.962152 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:08.962152 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:44:08.962152 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:44:08.962152 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:44:08.963156 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:44:08.963156 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:44:08.963156 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:44:08.963156 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:44:08.963156 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:44:08.963156 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:44:08.963156 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:44:08.963156 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 18 00:44:08.963156 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 18 00:44:08.963156 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 18 00:44:08.963156 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 18 00:44:08.963156 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:44:08.963156 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:44:08.963156 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:44:08.963156 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:44:08.963156 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:44:08.963156 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:44:08.964168 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:44:08.964168 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:44:08.964168 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:44:08.964168 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:44:08.964168 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:44:08.964168 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:44:08.964168 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:44:08.964168 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:44:08.964168 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:44:08.964168 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:44:08.964168 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 18 00:44:08.964168 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 00:44:08.964168 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 18 00:44:08.964168 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:44:08.966727 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 439/910] 10.222.0.15 () {56 vars in 1132 bytes} [Sun Sep 18 00:44:08 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:44:08.977226 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc5c72-8ec6-441b-be23-bd09c5928db6 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:09.094608 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc5c72-8ec6-441b-be23-bd09c5928db6 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:09.132365 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c010243-c2e8-4f6f-8431-1653313cc08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:09.132992 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c010243-c2e8-4f6f-8431-1653313cc08f None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:09.133276 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c010243-c2e8-4f6f-8431-1653313cc08f None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:09.133548 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c010243-c2e8-4f6f-8431-1653313cc08f None admin] PATH_INFO: `/v3/services` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:09.134188 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c010243-c2e8-4f6f-8431-1653313cc08f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:09.134495 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c010243-c2e8-4f6f-8431-1653313cc08f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:09.135885 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c010243-c2e8-4f6f-8431-1653313cc08f None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:09.141891 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 472/911] 10.222.0.15 () {56 vars in 1126 bytes} [Sun Sep 18 00:44:08 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:09.148462 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60874c6e-ed30-4e8a-becf-f83ccabbd494 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:09.272671 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60874c6e-ed30-4e8a-becf-f83ccabbd494 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:09.316347 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dba931-3e53-416f-af6a-5405f351511b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:09.317410 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dba931-3e53-416f-af6a-5405f351511b None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:09.317922 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dba931-3e53-416f-af6a-5405f351511b None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:09.318442 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dba931-3e53-416f-af6a-5405f351511b None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:09.319333 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dba931-3e53-416f-af6a-5405f351511b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:09.319868 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dba931-3e53-416f-af6a-5405f351511b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:09.321555 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dba931-3e53-416f-af6a-5405f351511b None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:09.323333 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:09.336179 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 440/912] 10.222.0.15 () {56 vars in 1126 bytes} [Sun Sep 18 00:44:09 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:09.339286 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c010243-c2e8-4f6f-8431-1653313cc08f None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:09.412538 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dba931-3e53-416f-af6a-5405f351511b None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:09.424327 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:09.467971 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c010243-c2e8-4f6f-8431-1653313cc08f None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:09.507537 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d945f-29df-4c75-b3e6-194ae19e494a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:09.508198 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d945f-29df-4c75-b3e6-194ae19e494a None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:09.508479 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d945f-29df-4c75-b3e6-194ae19e494a None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:09.508818 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d945f-29df-4c75-b3e6-194ae19e494a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:09.509711 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1d945f-29df-4c75-b3e6-194ae19e494a None admin] RBAC: Adding query filter params (interface=public, service_id=f84221f807e642c1aed5b4aab98806f1, region_id=RegionOne) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:09.510025 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1d945f-29df-4c75-b3e6-194ae19e494a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:09.511420 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1d945f-29df-4c75-b3e6-194ae19e494a None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:09.518718 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 473/913] 10.222.0.15 () {56 vars in 1251 bytes} [Sun Sep 18 00:44:09 2022] GET /identity/v3/endpoints?service_id=f84221f807e642c1aed5b4aab98806f1&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:09.524747 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d945f-29df-4c75-b3e6-194ae19e494a None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:09.590197 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dba931-3e53-416f-af6a-5405f351511b None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:09.654665 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323407a-2671-4bd9-af2e-113347843b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:09.656407 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323407a-2671-4bd9-af2e-113347843b51 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:09.657978 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323407a-2671-4bd9-af2e-113347843b51 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:09.658745 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323407a-2671-4bd9-af2e-113347843b51 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:09.685052 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3323407a-2671-4bd9-af2e-113347843b51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:44:09.688374 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d945f-29df-4c75-b3e6-194ae19e494a None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:09.696708 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-3323407a-2671-4bd9-af2e-113347843b51 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 18 00:44:09.696708 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:09.696708 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:44:09.696708 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:44:09.696708 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:44:09.696708 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:44:09.696708 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:44:09.696708 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:44:09.696708 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:44:09.696708 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:44:09.696708 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:44:09.696708 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:44:09.696708 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:44:09.696708 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:44:09.696708 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:44:09.696708 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:44:09.698534 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:44:09.698534 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:44:09.698534 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:44:09.698534 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:44:09.698534 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:44:09.698534 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:44:09.698534 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:44:09.698534 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:44:09.698534 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:44:09.698534 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:44:09.698534 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:44:09.698534 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:44:09.698534 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:44:09.698534 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:44:09.698534 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:44:09.698534 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:44:09.700828 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:44:09.700828 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:44:09.700828 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:44:09.700828 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:44:09.700828 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:44:09.700828 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:44:09.700828 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:44:09.700828 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:44:09.700828 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:44:09.700828 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:44:09.700828 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 18 00:44:09.700828 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:44:09.705563 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 441/914] 10.222.0.15 () {56 vars in 1120 bytes} [Sun Sep 18 00:44:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:44:09.715232 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323407a-2671-4bd9-af2e-113347843b51 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:09.738282 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:09.751749 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e0e0b9-c813-4564-b23a-955645455c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:09.753896 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0e0b9-c813-4564-b23a-955645455c03 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:09.754489 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0e0b9-c813-4564-b23a-955645455c03 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:09.755062 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0e0b9-c813-4564-b23a-955645455c03 None admin] PATH_INFO: `/v3/services` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:09.756489 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e0e0b9-c813-4564-b23a-955645455c03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:09.758811 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e0e0b9-c813-4564-b23a-955645455c03 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:09.774862 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 474/915] 10.222.0.15 () {56 vars in 1087 bytes} [Sun Sep 18 00:44:09 2022] GET /identity/v3/services => generated 1497 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 00:44:09.820358 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:09.852552 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323407a-2671-4bd9-af2e-113347843b51 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:09.898085 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a448304f-a7f0-49e1-aedf-a39988efdcd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:09.899136 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a448304f-a7f0-49e1-aedf-a39988efdcd3 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:09.899136 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a448304f-a7f0-49e1-aedf-a39988efdcd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:09.899415 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a448304f-a7f0-49e1-aedf-a39988efdcd3 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:09.900049 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a448304f-a7f0-49e1-aedf-a39988efdcd3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:09.900362 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a448304f-a7f0-49e1-aedf-a39988efdcd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:09.901852 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a448304f-a7f0-49e1-aedf-a39988efdcd3 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:09.914767 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 442/916] 10.222.0.15 () {56 vars in 1115 bytes} [Sun Sep 18 00:44:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:44:09.921733 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e0e0b9-c813-4564-b23a-955645455c03 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:10.123649 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e0e0b9-c813-4564-b23a-955645455c03 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:10.163917 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1befda00-c01f-488e-8812-2beb5ce5c794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:10.164732 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befda00-c01f-488e-8812-2beb5ce5c794 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:10.165027 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befda00-c01f-488e-8812-2beb5ce5c794 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:10.165307 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befda00-c01f-488e-8812-2beb5ce5c794 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:10.179001 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1befda00-c01f-488e-8812-2beb5ce5c794 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:10.180569 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1befda00-c01f-488e-8812-2beb5ce5c794 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:10.199260 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-1befda00-c01f-488e-8812-2beb5ce5c794 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:44:10.199260 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:10.199260 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:44:10.199260 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:44:10.199260 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:44:10.199260 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:44:10.199260 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:44:10.199260 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:44:10.199260 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:44:10.199260 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:44:10.199260 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:44:10.199260 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:44:10.199260 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:44:10.199260 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:44:10.199260 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:44:10.199260 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:44:10.201835 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:44:10.201835 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:44:10.201835 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:44:10.201835 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:44:10.201835 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:44:10.201835 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:44:10.201835 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:44:10.201835 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:44:10.201835 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:44:10.201835 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:44:10.201835 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:44:10.201835 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:44:10.201835 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:44:10.201835 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:44:10.201835 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:44:10.201835 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:44:10.201835 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:44:10.204021 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:44:10.204021 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:44:10.204021 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:44:10.204021 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 475/917] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:44:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:44:10.206563 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a448304f-a7f0-49e1-aedf-a39988efdcd3 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:10.286093 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b5d35-0763-4f2e-9dc2-3906e72eac71 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:10.286570 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b5d35-0763-4f2e-9dc2-3906e72eac71 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:10.286828 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b5d35-0763-4f2e-9dc2-3906e72eac71 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:10.288268 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 476/918] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:44:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 18 00:44:10.293913 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9d79e-d99d-4e2a-bafc-8598dff9942d None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:10.294297 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9d79e-d99d-4e2a-bafc-8598dff9942d None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:10.294546 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9d79e-d99d-4e2a-bafc-8598dff9942d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:10.316050 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-82d9d79e-d99d-4e2a-bafc-8598dff9942d None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:44:10.317482 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a448304f-a7f0-49e1-aedf-a39988efdcd3 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:10.318049 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-82d9d79e-d99d-4e2a-bafc-8598dff9942d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:44:10.343687 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:10.368112 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46650c43-4844-4730-bca2-4dc30fd65d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:10.369108 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46650c43-4844-4730-bca2-4dc30fd65d3d None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:10.369463 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46650c43-4844-4730-bca2-4dc30fd65d3d None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:10.369812 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46650c43-4844-4730-bca2-4dc30fd65d3d None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:10.370543 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46650c43-4844-4730-bca2-4dc30fd65d3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:10.370914 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46650c43-4844-4730-bca2-4dc30fd65d3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:10.372419 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46650c43-4844-4730-bca2-4dc30fd65d3d None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:10.382630 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:10.393860 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 443/919] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:44:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:10.393860 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75742f50-a5fb-4f6b-b80d-929fecafea24 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:10.393860 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75742f50-a5fb-4f6b-b80d-929fecafea24 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:10.393860 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75742f50-a5fb-4f6b-b80d-929fecafea24 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:10.393860 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 444/920] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:44:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:44:10.395378 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75742f50-a5fb-4f6b-b80d-929fecafea24 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:10.429347 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 477/921] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:44:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 18 00:44:10.430741 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21f1a3-b1c8-420d-a31e-85ca8d23e8fe None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:10.431034 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21f1a3-b1c8-420d-a31e-85ca8d23e8fe None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:10.431310 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21f1a3-b1c8-420d-a31e-85ca8d23e8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:10.453586 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-cb21f1a3-b1c8-420d-a31e-85ca8d23e8fe None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:44:10.454766 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-cb21f1a3-b1c8-420d-a31e-85ca8d23e8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:44:10.571927 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 478/922] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:44:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 00:44:10.586647 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75742f50-a5fb-4f6b-b80d-929fecafea24 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:10.628251 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e1b8c7-2ccb-4692-939f-0fc6beccc67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:10.628949 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1b8c7-2ccb-4692-939f-0fc6beccc67d None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:10.629241 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1b8c7-2ccb-4692-939f-0fc6beccc67d None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:10.629513 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1b8c7-2ccb-4692-939f-0fc6beccc67d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:10.639783 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e1b8c7-2ccb-4692-939f-0fc6beccc67d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:10.641383 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e1b8c7-2ccb-4692-939f-0fc6beccc67d None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:10.654981 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-94e1b8c7-2ccb-4692-939f-0fc6beccc67d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 18 00:44:10.654981 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:10.654981 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:44:10.654981 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:44:10.654981 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:44:10.654981 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:44:10.654981 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:44:10.654981 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:44:10.654981 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:44:10.654981 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:44:10.654981 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:44:10.654981 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:44:10.654981 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 00:44:10.654981 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 00:44:10.654981 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 00:44:10.654981 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 00:44:10.657659 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:44:10.657659 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:44:10.657659 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 00:44:10.657659 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:44:10.657659 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 00:44:10.657659 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:44:10.657659 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:44:10.657659 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:44:10.657659 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:44:10.657659 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:44:10.657659 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:44:10.657659 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:44:10.657659 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:44:10.657659 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:44:10.657659 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:44:10.657659 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:44:10.657659 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:44:10.657659 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:44:10.660433 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:44:10.660433 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:44:10.660433 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 00:44:10.660433 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 00:44:10.660433 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 00:44:10.660433 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 00:44:10.660433 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 00:44:10.660433 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 00:44:10.660433 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 18 00:44:10.660433 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:44:10.660433 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 445/923] 10.222.0.15 () {56 vars in 1117 bytes} [Sun Sep 18 00:44:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:44:10.669840 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb21f1a3-b1c8-420d-a31e-85ca8d23e8fe None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:10.847159 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb21f1a3-b1c8-420d-a31e-85ca8d23e8fe None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:10.851173 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:10.893509 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e1b8c7-2ccb-4692-939f-0fc6beccc67d None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:10.915872 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e1b1a-61e0-473a-9ca9-8c4c5603d2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:10.917611 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e1b1a-61e0-473a-9ca9-8c4c5603d2d4 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:10.918314 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e1b1a-61e0-473a-9ca9-8c4c5603d2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:10.919928 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e1b1a-61e0-473a-9ca9-8c4c5603d2d4 None admin] PATH_INFO: `/v3/users` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:10.922838 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078e1b1a-61e0-473a-9ca9-8c4c5603d2d4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:10.924295 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078e1b1a-61e0-473a-9ca9-8c4c5603d2d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:10.928879 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078e1b1a-61e0-473a-9ca9-8c4c5603d2d4 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:10.944270 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:10.966542 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 479/924] 10.222.0.15 () {56 vars in 1149 bytes} [Sun Sep 18 00:44:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:10.968583 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e1b1a-61e0-473a-9ca9-8c4c5603d2d4 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:11.047834 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e1b8c7-2ccb-4692-939f-0fc6beccc67d None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:11.092806 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7936cb-e9bd-46fa-800e-be2104f29900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:11.093761 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7936cb-e9bd-46fa-800e-be2104f29900 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:11.094178 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7936cb-e9bd-46fa-800e-be2104f29900 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:11.094590 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7936cb-e9bd-46fa-800e-be2104f29900 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:11.095439 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7936cb-e9bd-46fa-800e-be2104f29900 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:11.097305 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7936cb-e9bd-46fa-800e-be2104f29900 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:11.108881 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-3d7936cb-e9bd-46fa-800e-be2104f29900 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 18 00:44:11.108881 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:11.108881 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 18 00:44:11.108881 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 18 00:44:11.108881 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 18 00:44:11.108881 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 18 00:44:11.108881 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 18 00:44:11.108881 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 00:44:11.108881 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 18 00:44:11.108881 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:44:11.108881 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 18 00:44:11.108881 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:44:11.108881 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:11.108881 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:44:11.108881 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:44:11.108881 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:44:11.108881 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:44:11.116131 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:44:11.116131 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:44:11.116131 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:44:11.116131 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:44:11.116131 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:44:11.116131 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:44:11.116131 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 18 00:44:11.116131 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 18 00:44:11.116131 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 18 00:44:11.116131 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 18 00:44:11.116131 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:44:11.116131 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:44:11.116131 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:44:11.116131 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:44:11.116131 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:44:11.116131 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:44:11.117122 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:44:11.117122 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:44:11.117122 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:44:11.117122 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:44:11.117122 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:44:11.117122 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:44:11.117122 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:44:11.117122 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:44:11.117122 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:44:11.117122 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:44:11.117122 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 18 00:44:11.117122 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 00:44:11.117122 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 18 00:44:11.117122 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:44:11.117122 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 446/925] 10.222.0.15 () {56 vars in 1126 bytes} [Sun Sep 18 00:44:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:44:11.118034 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7936cb-e9bd-46fa-800e-be2104f29900 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:11.124905 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e1b1a-61e0-473a-9ca9-8c4c5603d2d4 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:11.169633 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8139baba-3621-4bed-af49-387a5df4dd6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:11.170581 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139baba-3621-4bed-af49-387a5df4dd6b None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:11.170865 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139baba-3621-4bed-af49-387a5df4dd6b None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:11.171134 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139baba-3621-4bed-af49-387a5df4dd6b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:11.172862 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8139baba-3621-4bed-af49-387a5df4dd6b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:11.176677 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8139baba-3621-4bed-af49-387a5df4dd6b None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:11.196489 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-8139baba-3621-4bed-af49-387a5df4dd6b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 18 00:44:11.196489 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:11.196489 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 18 00:44:11.196489 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 18 00:44:11.196489 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 18 00:44:11.196489 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 18 00:44:11.196489 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 18 00:44:11.196489 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 00:44:11.196489 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 18 00:44:11.196489 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:44:11.196489 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 18 00:44:11.196489 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:44:11.196489 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:11.196489 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:44:11.196489 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:44:11.196489 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:44:11.196489 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:44:11.197545 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:44:11.197545 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:44:11.197545 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:44:11.197545 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:44:11.197545 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:44:11.197545 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:44:11.197545 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 18 00:44:11.197545 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 18 00:44:11.197545 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 18 00:44:11.197545 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 18 00:44:11.197545 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:44:11.197545 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:44:11.197545 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:44:11.197545 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:44:11.197545 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:44:11.197545 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:44:11.198372 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:44:11.198372 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:44:11.198372 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:44:11.198372 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:44:11.198372 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:44:11.198372 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:44:11.198372 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:44:11.198372 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:44:11.198372 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:44:11.198372 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:44:11.198372 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 18 00:44:11.198372 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 00:44:11.198372 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 18 00:44:11.198372 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:44:11.198372 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 480/926] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Sep 18 00:44:10 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:44:11.200240 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8139baba-3621-4bed-af49-387a5df4dd6b None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:11.247553 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:11.256036 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7936cb-e9bd-46fa-800e-be2104f29900 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:11.259647 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:11.296124 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36807c3a-d80b-4825-a04a-05109cf8590b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:11.296923 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36807c3a-d80b-4825-a04a-05109cf8590b None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:11.297280 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36807c3a-d80b-4825-a04a-05109cf8590b None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:11.297553 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36807c3a-d80b-4825-a04a-05109cf8590b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:11.309370 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36807c3a-d80b-4825-a04a-05109cf8590b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:11.310823 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36807c3a-d80b-4825-a04a-05109cf8590b None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:11.325968 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-36807c3a-d80b-4825-a04a-05109cf8590b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:44:11.325968 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:11.325968 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:44:11.325968 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:44:11.325968 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:44:11.325968 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:44:11.325968 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:44:11.325968 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:44:11.325968 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:44:11.325968 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:44:11.325968 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:44:11.325968 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:44:11.325968 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:44:11.325968 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:44:11.325968 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:44:11.325968 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:44:11.326954 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:44:11.326954 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:44:11.326954 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:44:11.326954 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:44:11.326954 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:44:11.326954 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:44:11.326954 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:44:11.326954 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:44:11.326954 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:44:11.326954 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:44:11.326954 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:44:11.326954 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:44:11.326954 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:44:11.326954 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:44:11.326954 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:44:11.326954 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:44:11.326954 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:44:11.327819 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:44:11.327819 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:44:11.327819 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:44:11.331946 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 447/927] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:44:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:44:11.332588 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36807c3a-d80b-4825-a04a-05109cf8590b None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:11.376210 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8139baba-3621-4bed-af49-387a5df4dd6b None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:11.438803 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe2c63d-f514-44ed-9afd-2d4b69c08aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:11.439729 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2c63d-f514-44ed-9afd-2d4b69c08aaa None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:11.440161 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36807c3a-d80b-4825-a04a-05109cf8590b None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:11.440269 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2c63d-f514-44ed-9afd-2d4b69c08aaa None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:11.440691 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2c63d-f514-44ed-9afd-2d4b69c08aaa None admin] PATH_INFO: `/v3/services` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:11.441824 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe2c63d-f514-44ed-9afd-2d4b69c08aaa None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:11.442377 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe2c63d-f514-44ed-9afd-2d4b69c08aaa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:11.444947 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe2c63d-f514-44ed-9afd-2d4b69c08aaa None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:11.454755 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 481/928] 10.222.0.15 () {56 vars in 1122 bytes} [Sun Sep 18 00:44:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:11.456153 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe2c63d-f514-44ed-9afd-2d4b69c08aaa None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:11.491667 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98be034-effc-4e68-a1c5-c8c223207f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:11.492329 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98be034-effc-4e68-a1c5-c8c223207f8c None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:11.492608 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98be034-effc-4e68-a1c5-c8c223207f8c None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:11.492875 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98be034-effc-4e68-a1c5-c8c223207f8c None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:11.493616 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98be034-effc-4e68-a1c5-c8c223207f8c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:11.493908 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98be034-effc-4e68-a1c5-c8c223207f8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:11.495283 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98be034-effc-4e68-a1c5-c8c223207f8c None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:11.504968 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 448/929] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Sep 18 00:44:11 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:11.504968 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98be034-effc-4e68-a1c5-c8c223207f8c None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:11.530971 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:11.597836 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:11.614159 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe2c63d-f514-44ed-9afd-2d4b69c08aaa None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:11.638978 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98be034-effc-4e68-a1c5-c8c223207f8c None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:11.657013 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c8230e-614e-46e5-9c42-419ca20087a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:11.657746 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8230e-614e-46e5-9c42-419ca20087a3 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:11.658175 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8230e-614e-46e5-9c42-419ca20087a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:11.658356 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8230e-614e-46e5-9c42-419ca20087a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:11.658993 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c8230e-614e-46e5-9c42-419ca20087a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:11.659291 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c8230e-614e-46e5-9c42-419ca20087a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:11.661620 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c8230e-614e-46e5-9c42-419ca20087a3 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:11.685633 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 482/930] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:44:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:11.685633 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c8230e-614e-46e5-9c42-419ca20087a3 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:11.690567 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66581f0a-fb3a-4c89-b35f-84b1e964d753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:11.691535 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66581f0a-fb3a-4c89-b35f-84b1e964d753 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:11.693292 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66581f0a-fb3a-4c89-b35f-84b1e964d753 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:11.693292 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66581f0a-fb3a-4c89-b35f-84b1e964d753 None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:11.693913 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66581f0a-fb3a-4c89-b35f-84b1e964d753 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:11.694456 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66581f0a-fb3a-4c89-b35f-84b1e964d753 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:11.696864 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66581f0a-fb3a-4c89-b35f-84b1e964d753 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:11.710527 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 449/931] 10.222.0.15 () {56 vars in 1122 bytes} [Sun Sep 18 00:44:11 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:11.710527 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66581f0a-fb3a-4c89-b35f-84b1e964d753 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:11.853596 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c8230e-614e-46e5-9c42-419ca20087a3 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:11.855394 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:11.882692 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66581f0a-fb3a-4c89-b35f-84b1e964d753 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:11.911214 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5932ca-a66b-4294-b28f-a34a0f3a8d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:11.912218 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5932ca-a66b-4294-b28f-a34a0f3a8d9e None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:11.912559 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5932ca-a66b-4294-b28f-a34a0f3a8d9e None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:11.912838 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5932ca-a66b-4294-b28f-a34a0f3a8d9e None admin] PATH_INFO: `/v3/services` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:11.913686 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5932ca-a66b-4294-b28f-a34a0f3a8d9e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:11.914192 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5932ca-a66b-4294-b28f-a34a0f3a8d9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:11.916874 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5932ca-a66b-4294-b28f-a34a0f3a8d9e None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:11.935968 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 483/932] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Sep 18 00:44:11 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:11.935968 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5932ca-a66b-4294-b28f-a34a0f3a8d9e None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:11.950997 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d57905-f45b-4110-b52a-30ab52d576ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:11.951998 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d57905-f45b-4110-b52a-30ab52d576ef None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:11.952427 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d57905-f45b-4110-b52a-30ab52d576ef None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:11.952872 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d57905-f45b-4110-b52a-30ab52d576ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:11.962431 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:11.964858 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d57905-f45b-4110-b52a-30ab52d576ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:11.966744 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d57905-f45b-4110-b52a-30ab52d576ef None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:11.980328 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-55d57905-f45b-4110-b52a-30ab52d576ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:44:11.980328 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:11.980328 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:44:11.980328 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:44:11.980328 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:44:11.980328 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:44:11.980328 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:44:11.980328 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:44:11.980328 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:44:11.980328 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:44:11.980328 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:44:11.980328 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:44:11.980328 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 00:44:11.980328 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 00:44:11.980328 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 00:44:11.982068 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 00:44:11.982068 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:44:11.982068 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:44:11.982068 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:44:11.982068 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:44:11.982068 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:44:11.982068 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:44:11.982068 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:44:11.982068 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:44:11.982068 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:44:11.982068 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:44:11.982068 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:44:11.982068 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:44:11.982068 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:44:11.982068 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:44:11.982068 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:44:11.982068 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:44:11.983824 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 00:44:11.983824 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 00:44:11.983824 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 00:44:11.983824 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 00:44:11.983824 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 00:44:11.983824 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 00:44:11.983824 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:44:11.983824 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:44:11.983824 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 450/933] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Sep 18 00:44:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:44:11.983824 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d57905-f45b-4110-b52a-30ab52d576ef None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:12.079503 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5932ca-a66b-4294-b28f-a34a0f3a8d9e None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:12.113310 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d57905-f45b-4110-b52a-30ab52d576ef None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:12.116797 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eea3220-cc5c-43d1-817f-eb046a008cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:12.117599 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea3220-cc5c-43d1-817f-eb046a008cb6 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:12.117888 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea3220-cc5c-43d1-817f-eb046a008cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:12.118169 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea3220-cc5c-43d1-817f-eb046a008cb6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:12.119469 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eea3220-cc5c-43d1-817f-eb046a008cb6 None admin] RBAC: Adding query filter params (interface=public, service_id=a1f4d4032e104d26b87e7273f68fb41e, region_id=RegionOne) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:12.119997 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eea3220-cc5c-43d1-817f-eb046a008cb6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:12.121401 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eea3220-cc5c-43d1-817f-eb046a008cb6 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:12.127024 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 484/934] 10.222.0.15 () {56 vars in 1251 bytes} [Sun Sep 18 00:44:11 2022] GET /identity/v3/endpoints?service_id=a1f4d4032e104d26b87e7273f68fb41e&interface=public®ion_id=RegionOne => generated 194 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:12.128017 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eea3220-cc5c-43d1-817f-eb046a008cb6 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:12.159348 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70b81d-61dc-4c2a-b9a6-c1da0ae9ce04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:12.160151 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70b81d-61dc-4c2a-b9a6-c1da0ae9ce04 None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:12.160591 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70b81d-61dc-4c2a-b9a6-c1da0ae9ce04 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:12.160985 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70b81d-61dc-4c2a-b9a6-c1da0ae9ce04 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:12.161947 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a70b81d-61dc-4c2a-b9a6-c1da0ae9ce04 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:12.163632 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a70b81d-61dc-4c2a-b9a6-c1da0ae9ce04 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:12.183249 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:12.189570 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 451/935] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Sep 18 00:44:11 2022] POST /identity/v3/endpoints => generated 346 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 00:44:12.190951 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d48de91-e2bf-49f2-9fff-1d7895341d55 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:12.191336 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d48de91-e2bf-49f2-9fff-1d7895341d55 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:12.191497 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d48de91-e2bf-49f2-9fff-1d7895341d55 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:12.198905 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 452/936] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:44:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:44:12.198905 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d48de91-e2bf-49f2-9fff-1d7895341d55 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:12.247383 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:12.289721 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eea3220-cc5c-43d1-817f-eb046a008cb6 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:12.363745 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407065d7-591d-4f1d-ab85-1d2964316406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:12.364788 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407065d7-591d-4f1d-ab85-1d2964316406 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:12.365250 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407065d7-591d-4f1d-ab85-1d2964316406 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:12.365715 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407065d7-591d-4f1d-ab85-1d2964316406 None admin] PATH_INFO: `/v3/projects` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:12.366708 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407065d7-591d-4f1d-ab85-1d2964316406 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:12.367216 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407065d7-591d-4f1d-ab85-1d2964316406 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:12.369695 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407065d7-591d-4f1d-ab85-1d2964316406 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:12.372075 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d48de91-e2bf-49f2-9fff-1d7895341d55 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:12.391821 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 485/937] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Sep 18 00:44:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:12.394111 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169f2d1-4270-4e13-87d4-d8be99ec6e2f None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:12.394608 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169f2d1-4270-4e13-87d4-d8be99ec6e2f None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:12.395100 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169f2d1-4270-4e13-87d4-d8be99ec6e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:12.419021 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-a169f2d1-4270-4e13-87d4-d8be99ec6e2f None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:44:12.420149 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81f0b58-5b9c-42c3-b6dd-98b7c131a129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:12.420376 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-a169f2d1-4270-4e13-87d4-d8be99ec6e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:44:12.421686 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f0b58-5b9c-42c3-b6dd-98b7c131a129 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:12.421686 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f0b58-5b9c-42c3-b6dd-98b7c131a129 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:12.421686 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f0b58-5b9c-42c3-b6dd-98b7c131a129 None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:12.422607 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81f0b58-5b9c-42c3-b6dd-98b7c131a129 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:12.423885 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81f0b58-5b9c-42c3-b6dd-98b7c131a129 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:12.430552 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 453/938] 10.222.0.15 () {56 vars in 1087 bytes} [Sun Sep 18 00:44:12 2022] GET /identity/v3/services => generated 1497 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 00:44:12.431407 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81f0b58-5b9c-42c3-b6dd-98b7c131a129 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:12.545968 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 486/939] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:44:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 00:44:12.554557 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:12.637068 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81f0b58-5b9c-42c3-b6dd-98b7c131a129 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:12.702497 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad19d08-4b46-4cdf-bb1b-debec2e7dd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:12.703252 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad19d08-4b46-4cdf-bb1b-debec2e7dd8c None admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:12.703541 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad19d08-4b46-4cdf-bb1b-debec2e7dd8c None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:12.703825 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad19d08-4b46-4cdf-bb1b-debec2e7dd8c None admin] PATH_INFO: `/v3/projects/52ebde8fa3f84ede9ef575f7c0780798/users/9afbb5a9f364495ca55089dd6ddd7934/roles/5e489759b2bc48d6b3895ed9d1f79f19` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:12.707145 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad19d08-4b46-4cdf-bb1b-debec2e7dd8c None admin] RBAC: Authorizing `identity:create_grant(project_id=52ebde8fa3f84ede9ef575f7c0780798, user_id=9afbb5a9f364495ca55089dd6ddd7934, role_id=5e489759b2bc48d6b3895ed9d1f79f19)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:12.708758 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad19d08-4b46-4cdf-bb1b-debec2e7dd8c None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:12.729098 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 454/940] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Sep 18 00:44:12 2022] PUT /identity/v3/projects/52ebde8fa3f84ede9ef575f7c0780798/users/9afbb5a9f364495ca55089dd6ddd7934/roles/5e489759b2bc48d6b3895ed9d1f79f19 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 00:44:12.908490 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a169f2d1-4270-4e13-87d4-d8be99ec6e2f None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:12.990267 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:13.043071 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a169f2d1-4270-4e13-87d4-d8be99ec6e2f None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:13.112217 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933dfa41-5f4b-47eb-8e24-c4fad96dc348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:13.113837 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933dfa41-5f4b-47eb-8e24-c4fad96dc348 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:13.114642 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933dfa41-5f4b-47eb-8e24-c4fad96dc348 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:13.115439 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933dfa41-5f4b-47eb-8e24-c4fad96dc348 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:13.116953 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933dfa41-5f4b-47eb-8e24-c4fad96dc348 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:13.119886 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933dfa41-5f4b-47eb-8e24-c4fad96dc348 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:13.137614 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-933dfa41-5f4b-47eb-8e24-c4fad96dc348 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 18 00:44:13.137614 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:13.137614 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 18 00:44:13.137614 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 18 00:44:13.137614 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 18 00:44:13.137614 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 18 00:44:13.137614 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 18 00:44:13.137614 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 00:44:13.137614 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 18 00:44:13.137614 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:44:13.137614 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 18 00:44:13.137614 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:44:13.137614 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:13.137614 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:44:13.137614 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:44:13.137614 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:44:13.139409 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:44:13.139409 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:44:13.139409 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:44:13.139409 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:44:13.139409 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:44:13.139409 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:44:13.139409 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:44:13.139409 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 18 00:44:13.139409 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 18 00:44:13.139409 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 18 00:44:13.139409 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 18 00:44:13.139409 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:44:13.139409 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:44:13.139409 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:44:13.139409 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:44:13.139409 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:44:13.139409 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:44:13.141714 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:44:13.141714 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:44:13.141714 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:44:13.141714 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:44:13.141714 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:44:13.141714 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:44:13.141714 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:44:13.141714 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:44:13.141714 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:44:13.141714 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:44:13.141714 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 18 00:44:13.141714 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 00:44:13.141714 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 18 00:44:13.141714 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:44:13.146647 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 487/941] 10.222.0.15 () {56 vars in 1132 bytes} [Sun Sep 18 00:44:12 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 00:44:13.152402 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad19d08-4b46-4cdf-bb1b-debec2e7dd8c None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:13.270397 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad19d08-4b46-4cdf-bb1b-debec2e7dd8c None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:13.297661 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:13.310943 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33399bba-0a09-4863-a800-4bb3a0149c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:13.311570 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33399bba-0a09-4863-a800-4bb3a0149c51 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:13.311954 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33399bba-0a09-4863-a800-4bb3a0149c51 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:13.312231 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33399bba-0a09-4863-a800-4bb3a0149c51 None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:13.313042 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33399bba-0a09-4863-a800-4bb3a0149c51 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:13.313361 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33399bba-0a09-4863-a800-4bb3a0149c51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:13.315319 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33399bba-0a09-4863-a800-4bb3a0149c51 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:13.321314 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 455/942] 10.222.0.15 () {56 vars in 1126 bytes} [Sun Sep 18 00:44:13 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:13.328096 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933dfa41-5f4b-47eb-8e24-c4fad96dc348 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:13.520661 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933dfa41-5f4b-47eb-8e24-c4fad96dc348 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:13.587197 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f015c-1cdc-4142-92ba-5d3b8db31767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:13.588361 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f015c-1cdc-4142-92ba-5d3b8db31767 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:13.589033 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f015c-1cdc-4142-92ba-5d3b8db31767 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:13.589523 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f015c-1cdc-4142-92ba-5d3b8db31767 None admin] PATH_INFO: `/v3/services` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:13.592183 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:13.593102 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94f015c-1cdc-4142-92ba-5d3b8db31767 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:13.593676 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94f015c-1cdc-4142-92ba-5d3b8db31767 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:13.596971 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94f015c-1cdc-4142-92ba-5d3b8db31767 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:13.607906 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 488/943] 10.222.0.15 () {56 vars in 1126 bytes} [Sun Sep 18 00:44:13 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:44:13.613402 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33399bba-0a09-4863-a800-4bb3a0149c51 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:13.799929 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33399bba-0a09-4863-a800-4bb3a0149c51 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:13.867249 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd2da32-66ab-4eda-b507-12d6714bf6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:13.868316 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2da32-66ab-4eda-b507-12d6714bf6cd None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:13.868812 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2da32-66ab-4eda-b507-12d6714bf6cd None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:13.869305 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2da32-66ab-4eda-b507-12d6714bf6cd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:13.870552 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd2da32-66ab-4eda-b507-12d6714bf6cd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:13.873336 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd2da32-66ab-4eda-b507-12d6714bf6cd None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:13.912260 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 456/944] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Sep 18 00:44:13 2022] POST /identity/v3/endpoints => generated 347 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 00:44:14.706779 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88132aad-f83e-4aad-be4b-77eb1b0e2873 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:14.707576 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88132aad-f83e-4aad-be4b-77eb1b0e2873 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:14.707576 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88132aad-f83e-4aad-be4b-77eb1b0e2873 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:14.709087 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 489/945] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:44:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:44:14.715121 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be584c-40ac-41d9-bdca-3aadb583e0e1 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:14.716079 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be584c-40ac-41d9-bdca-3aadb583e0e1 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:14.716079 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be584c-40ac-41d9-bdca-3aadb583e0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:14.737151 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-23be584c-40ac-41d9-bdca-3aadb583e0e1 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:44:14.738384 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-23be584c-40ac-41d9-bdca-3aadb583e0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:44:14.788310 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:14.829998 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 457/946] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:44:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 00:44:15.110491 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88132aad-f83e-4aad-be4b-77eb1b0e2873 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:15.280715 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88132aad-f83e-4aad-be4b-77eb1b0e2873 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:15.344620 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cffea17-36fc-4dd5-8ac8-2746ac2a533c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:15.345638 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cffea17-36fc-4dd5-8ac8-2746ac2a533c None admin] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:15.346138 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cffea17-36fc-4dd5-8ac8-2746ac2a533c None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:15.346635 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cffea17-36fc-4dd5-8ac8-2746ac2a533c None admin] PATH_INFO: `/v3/projects` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:15.347820 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cffea17-36fc-4dd5-8ac8-2746ac2a533c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:15.350726 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cffea17-36fc-4dd5-8ac8-2746ac2a533c None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:15.355422 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: WARNING keystone.server.flask.common [None req-6cffea17-36fc-4dd5-8ac8-2746ac2a533c None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 18 00:44:15.393998 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.sql.core [None req-6cffea17-36fc-4dd5-8ac8-2746ac2a533c None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 18 00:44:15.393998 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 18 00:44:15.393998 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [parameters: {'id': '52d2aca52ffe482ab9d2723959004b1c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 18 00:44:15.393998 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81571) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 18 00:44:15.418446 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-6cffea17-36fc-4dd5-8ac8-2746ac2a533c None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 52d2aca52ffe482ab9d2723959004b1c.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 52d2aca52ffe482ab9d2723959004b1c. Sep 18 00:44:15.418446 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:15.418446 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 18 00:44:15.418446 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 18 00:44:15.418446 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 18 00:44:15.418446 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 18 00:44:15.418446 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 18 00:44:15.418446 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application result = self._query(query) Sep 18 00:44:15.418446 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 18 00:44:15.418446 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application conn.query(q) Sep 18 00:44:15.418446 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 18 00:44:15.418446 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 18 00:44:15.418446 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 18 00:44:15.420146 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application result.read() Sep 18 00:44:15.420146 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 18 00:44:15.420146 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 18 00:44:15.420146 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 18 00:44:15.420146 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 18 00:44:15.420146 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 18 00:44:15.420146 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 18 00:44:15.420146 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 18 00:44:15.420146 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 18 00:44:15.420146 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 18 00:44:15.420146 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:44:15.420146 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 18 00:44:15.420146 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:44:15.420146 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:15.420146 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 18 00:44:15.420146 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 18 00:44:15.420146 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 18 00:44:15.420146 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 18 00:44:15.422597 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 18 00:44:15.422597 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application next(self.gen) Sep 18 00:44:15.422597 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 18 00:44:15.422597 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application yield resource Sep 18 00:44:15.422597 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 18 00:44:15.422597 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application next(self.gen) Sep 18 00:44:15.422597 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 18 00:44:15.422597 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application self.session.rollback() Sep 18 00:44:15.422597 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 18 00:44:15.422597 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application self.force_reraise() Sep 18 00:44:15.422597 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 18 00:44:15.422597 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise self.value Sep 18 00:44:15.422597 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 18 00:44:15.422597 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 18 00:44:15.422597 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 18 00:44:15.422597 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application session.commit() Sep 18 00:44:15.422597 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 18 00:44:15.424534 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 18 00:44:15.424534 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 18 00:44:15.424534 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application self._prepare_impl() Sep 18 00:44:15.424534 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 18 00:44:15.424534 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application self.session.flush() Sep 18 00:44:15.424534 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 18 00:44:15.424534 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application self._flush(objects) Sep 18 00:44:15.424534 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 18 00:44:15.424534 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 18 00:44:15.424534 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 18 00:44:15.424534 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application compat.raise_( Sep 18 00:44:15.424534 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 18 00:44:15.424534 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception Sep 18 00:44:15.424534 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 18 00:44:15.424534 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application flush_context.execute() Sep 18 00:44:15.424534 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 18 00:44:15.424534 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rec.execute(self) Sep 18 00:44:15.426603 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 18 00:44:15.426603 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 18 00:44:15.426603 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 18 00:44:15.426603 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 18 00:44:15.426603 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 18 00:44:15.426603 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 18 00:44:15.426603 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 18 00:44:15.426603 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 18 00:44:15.426603 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 18 00:44:15.426603 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 18 00:44:15.426603 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 18 00:44:15.426603 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 18 00:44:15.426603 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 18 00:44:15.426603 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 18 00:44:15.426603 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 18 00:44:15.441308 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 18 00:44:15.441308 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 18 00:44:15.441308 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception Sep 18 00:44:15.441308 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 18 00:44:15.441308 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 18 00:44:15.441308 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 18 00:44:15.441308 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 18 00:44:15.441308 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 18 00:44:15.441308 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application result = self._query(query) Sep 18 00:44:15.441308 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 18 00:44:15.441308 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application conn.query(q) Sep 18 00:44:15.441308 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 18 00:44:15.441308 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 18 00:44:15.441308 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 18 00:44:15.441308 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application result.read() Sep 18 00:44:15.441308 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 18 00:44:15.441308 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 18 00:44:15.445119 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 18 00:44:15.445119 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 18 00:44:15.445119 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 18 00:44:15.445119 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 18 00:44:15.445119 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 18 00:44:15.445119 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 18 00:44:15.445119 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 18 00:44:15.445119 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 18 00:44:15.445119 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [parameters: {'id': '52d2aca52ffe482ab9d2723959004b1c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 18 00:44:15.445119 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 18 00:44:15.445119 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:44:15.445119 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 18 00:44:15.445119 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:44:15.445119 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:15.445119 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 18 00:44:15.448361 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 18 00:44:15.448361 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 18 00:44:15.448361 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 18 00:44:15.448361 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 18 00:44:15.448361 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:44:15.448361 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 18 00:44:15.448361 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:44:15.448361 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:15.448361 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:44:15.448361 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:44:15.448361 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:44:15.448361 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:44:15.448361 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:44:15.448361 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:44:15.448361 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:44:15.448361 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:44:15.448361 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:44:15.452232 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:44:15.452232 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 18 00:44:15.452232 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 18 00:44:15.452232 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:44:15.452232 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:44:15.452232 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 18 00:44:15.452232 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 18 00:44:15.452232 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 52d2aca52ffe482ab9d2723959004b1c. Sep 18 00:44:15.452232 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:44:15.452232 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 490/947] 10.222.0.15 () {60 vars in 1140 bytes} [Sun Sep 18 00:44:15 2022] POST /identity/v3/projects => generated 262 bytes in 312 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:44:15.461781 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be584c-40ac-41d9-bdca-3aadb583e0e1 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:15.549515 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75cca0c-f86d-44bb-8463-f02fff5c6b23 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:15.549996 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75cca0c-f86d-44bb-8463-f02fff5c6b23 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:15.550669 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75cca0c-f86d-44bb-8463-f02fff5c6b23 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:15.560365 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 491/948] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:44:15 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:44:15.569822 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfbf5f2-7b6a-4fe9-92ed-2a89e50f5275 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:15.570548 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfbf5f2-7b6a-4fe9-92ed-2a89e50f5275 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:15.570975 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfbf5f2-7b6a-4fe9-92ed-2a89e50f5275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:15.591621 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-8cfbf5f2-7b6a-4fe9-92ed-2a89e50f5275 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:44:15.593213 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-8cfbf5f2-7b6a-4fe9-92ed-2a89e50f5275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:44:15.601023 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be584c-40ac-41d9-bdca-3aadb583e0e1 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:15.638993 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:15.657231 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77a468f-6538-4413-90bd-65f431a6ae59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:15.657888 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a468f-6538-4413-90bd-65f431a6ae59 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:15.658174 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a468f-6538-4413-90bd-65f431a6ae59 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:15.658452 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a468f-6538-4413-90bd-65f431a6ae59 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:15.667090 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77a468f-6538-4413-90bd-65f431a6ae59 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:15.668606 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77a468f-6538-4413-90bd-65f431a6ae59 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:15.680706 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-a77a468f-6538-4413-90bd-65f431a6ae59 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:44:15.680706 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:15.680706 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:44:15.680706 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:44:15.680706 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:44:15.680706 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:44:15.680706 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:44:15.680706 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:44:15.680706 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:44:15.680706 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:44:15.680706 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:44:15.680706 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:44:15.680706 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 00:44:15.680706 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 00:44:15.680706 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 00:44:15.681654 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 00:44:15.681654 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:44:15.681654 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:44:15.681654 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:44:15.681654 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:44:15.681654 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:44:15.681654 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:44:15.681654 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:44:15.681654 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:44:15.681654 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:44:15.681654 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:44:15.681654 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:44:15.681654 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:44:15.681654 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:44:15.681654 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:44:15.681654 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:44:15.681654 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:44:15.682680 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 00:44:15.682680 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 00:44:15.682680 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 00:44:15.682680 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 00:44:15.682680 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 00:44:15.682680 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 00:44:15.682680 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:44:15.682680 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:44:15.682680 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 458/949] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Sep 18 00:44:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:44:15.683691 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1568e7-d006-4852-967e-5dcfecdb2df6 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:15.683814 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1568e7-d006-4852-967e-5dcfecdb2df6 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:15.684117 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1568e7-d006-4852-967e-5dcfecdb2df6 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:15.687942 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 459/950] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:44:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:44:15.690165 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 492/951] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:44:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 18 00:44:15.690884 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1568e7-d006-4852-967e-5dcfecdb2df6 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:15.698521 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919723a-9c60-431d-b97d-a2580d8ac545 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:15.698521 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919723a-9c60-431d-b97d-a2580d8ac545 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:15.698521 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919723a-9c60-431d-b97d-a2580d8ac545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:15.732264 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-b919723a-9c60-431d-b97d-a2580d8ac545 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:44:15.734499 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-b919723a-9c60-431d-b97d-a2580d8ac545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:44:15.751089 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:15.855193 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 493/952] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:44:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 18 00:44:15.898975 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1568e7-d006-4852-967e-5dcfecdb2df6 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:15.967164 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a16457-1e1c-4890-9083-71d3d611e4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:15.968218 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a16457-1e1c-4890-9083-71d3d611e4c9 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:15.972839 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a16457-1e1c-4890-9083-71d3d611e4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:15.973346 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a16457-1e1c-4890-9083-71d3d611e4c9 None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:15.975174 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a16457-1e1c-4890-9083-71d3d611e4c9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:15.975716 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a16457-1e1c-4890-9083-71d3d611e4c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:15.980419 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a16457-1e1c-4890-9083-71d3d611e4c9 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:15.991923 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b919723a-9c60-431d-b97d-a2580d8ac545 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:16.002864 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 460/953] 10.222.0.15 () {56 vars in 1112 bytes} [Sun Sep 18 00:44:15 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:16.195785 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b919723a-9c60-431d-b97d-a2580d8ac545 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:16.213939 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:16.258517 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3783f65-70f1-407c-a160-1f1683c9a49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:16.259392 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3783f65-70f1-407c-a160-1f1683c9a49c None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:16.259837 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3783f65-70f1-407c-a160-1f1683c9a49c None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:16.260371 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3783f65-70f1-407c-a160-1f1683c9a49c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:16.280564 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3783f65-70f1-407c-a160-1f1683c9a49c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:44:16.290114 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-b3783f65-70f1-407c-a160-1f1683c9a49c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 18 00:44:16.290114 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:16.290114 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:44:16.290114 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:44:16.290114 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:44:16.290114 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:44:16.290114 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:44:16.290114 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:44:16.290114 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:44:16.290114 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:44:16.290114 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:44:16.290114 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:44:16.290114 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:44:16.290114 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:44:16.290114 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:44:16.290114 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:44:16.291382 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:44:16.291382 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:44:16.291382 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:44:16.291382 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:44:16.291382 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:44:16.291382 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:44:16.291382 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:44:16.291382 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:44:16.291382 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:44:16.291382 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:44:16.291382 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:44:16.291382 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:44:16.291382 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:44:16.291382 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:44:16.291382 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:44:16.291382 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:44:16.292237 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:44:16.292237 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:44:16.292237 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:44:16.292237 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:44:16.292237 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:44:16.292237 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:44:16.292237 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:44:16.292237 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:44:16.292237 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:44:16.292237 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:44:16.292237 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 18 00:44:16.292237 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:44:16.292889 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 494/954] 10.222.0.15 () {56 vars in 1120 bytes} [Sun Sep 18 00:44:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 00:44:16.299985 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a16457-1e1c-4890-9083-71d3d611e4c9 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:16.368307 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3783f65-70f1-407c-a160-1f1683c9a49c None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:16.474567 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:16.486724 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a16457-1e1c-4890-9083-71d3d611e4c9 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:16.564079 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1bf1c-5ab8-4a91-be2d-d9814a6c5a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:16.565744 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1bf1c-5ab8-4a91-be2d-d9814a6c5a6a None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:16.566427 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1bf1c-5ab8-4a91-be2d-d9814a6c5a6a None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:16.567428 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1bf1c-5ab8-4a91-be2d-d9814a6c5a6a None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:16.569522 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c1bf1c-5ab8-4a91-be2d-d9814a6c5a6a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:16.570344 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c1bf1c-5ab8-4a91-be2d-d9814a6c5a6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:16.573526 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c1bf1c-5ab8-4a91-be2d-d9814a6c5a6a None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:16.574245 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3783f65-70f1-407c-a160-1f1683c9a49c None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:16.600453 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 461/955] 10.222.0.15 () {56 vars in 1115 bytes} [Sun Sep 18 00:44:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:16.601548 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1bf1c-5ab8-4a91-be2d-d9814a6c5a6a None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:16.633548 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b51eea-b39c-4381-b113-a0a21dae7bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:16.634206 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b51eea-b39c-4381-b113-a0a21dae7bad None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:16.634488 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b51eea-b39c-4381-b113-a0a21dae7bad None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:16.634787 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b51eea-b39c-4381-b113-a0a21dae7bad None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:16.635364 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b51eea-b39c-4381-b113-a0a21dae7bad None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:16.637015 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b51eea-b39c-4381-b113-a0a21dae7bad None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:16.647233 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-97b51eea-b39c-4381-b113-a0a21dae7bad None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 18 00:44:16.647233 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:16.647233 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 18 00:44:16.647233 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 18 00:44:16.647233 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 18 00:44:16.647233 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 18 00:44:16.647233 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 18 00:44:16.647233 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 00:44:16.647233 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 18 00:44:16.647233 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:44:16.647233 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 18 00:44:16.647233 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:44:16.647233 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:16.647233 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:44:16.647233 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:44:16.647233 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:44:16.647233 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:44:16.648418 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:44:16.648418 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:44:16.648418 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:44:16.648418 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:44:16.648418 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:44:16.648418 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:44:16.648418 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 18 00:44:16.648418 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 18 00:44:16.648418 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 18 00:44:16.648418 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 18 00:44:16.648418 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:44:16.648418 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:44:16.648418 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:44:16.648418 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:44:16.648418 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:44:16.648418 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:44:16.649275 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:44:16.649275 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:44:16.649275 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:44:16.649275 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:44:16.649275 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:44:16.649275 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:44:16.649275 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:44:16.649275 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:44:16.649275 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:44:16.649275 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:44:16.649275 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 18 00:44:16.649275 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 00:44:16.649275 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 18 00:44:16.649275 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:44:16.649275 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 495/956] 10.222.0.15 () {56 vars in 1126 bytes} [Sun Sep 18 00:44:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:44:16.660560 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b51eea-b39c-4381-b113-a0a21dae7bad None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:16.700418 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:16.766328 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1bf1c-5ab8-4a91-be2d-d9814a6c5a6a None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:16.784898 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b51eea-b39c-4381-b113-a0a21dae7bad None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:16.822924 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ef7f3e-0264-4bd7-88dc-b6106a3d648e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:16.823468 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef7f3e-0264-4bd7-88dc-b6106a3d648e None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:16.823749 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef7f3e-0264-4bd7-88dc-b6106a3d648e None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:16.824053 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef7f3e-0264-4bd7-88dc-b6106a3d648e None admin] PATH_INFO: `/v3/services` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:16.824691 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ef7f3e-0264-4bd7-88dc-b6106a3d648e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:16.824996 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ef7f3e-0264-4bd7-88dc-b6106a3d648e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:16.826374 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ef7f3e-0264-4bd7-88dc-b6106a3d648e None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:16.830624 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6710cdef-9525-4439-b9b6-8215396439a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:16.831710 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710cdef-9525-4439-b9b6-8215396439a0 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:16.832272 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710cdef-9525-4439-b9b6-8215396439a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:16.837440 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 496/957] 10.222.0.15 () {56 vars in 1122 bytes} [Sun Sep 18 00:44:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:44:16.837629 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710cdef-9525-4439-b9b6-8215396439a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:16.837713 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b1c7c-7e1c-4845-8931-6eb47eda43e0 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:16.837713 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b1c7c-7e1c-4845-8931-6eb47eda43e0 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:16.837713 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b1c7c-7e1c-4845-8931-6eb47eda43e0 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:16.837713 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 497/958] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:44:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:44:16.838156 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646b1c7c-7e1c-4845-8931-6eb47eda43e0 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:16.862632 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6710cdef-9525-4439-b9b6-8215396439a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:16.865376 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6710cdef-9525-4439-b9b6-8215396439a0 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:16.892641 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-6710cdef-9525-4439-b9b6-8215396439a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:44:16.892641 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:16.892641 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:44:16.892641 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:44:16.892641 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:44:16.892641 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:44:16.892641 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:44:16.892641 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:44:16.892641 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:44:16.892641 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:44:16.892641 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:44:16.892641 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:44:16.892641 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:44:16.892641 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:44:16.892641 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:44:16.892641 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:44:16.893648 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:44:16.893648 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:44:16.893648 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:44:16.893648 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:44:16.893648 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:44:16.893648 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:44:16.893648 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:44:16.893648 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:44:16.893648 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:44:16.893648 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:44:16.893648 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:44:16.893648 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:44:16.893648 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:44:16.893648 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:44:16.893648 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:44:16.893648 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:44:16.893648 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:44:16.894519 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:44:16.894519 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:44:16.894519 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:44:16.894687 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 462/959] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:44:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:44:16.900509 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2dc25d-9a50-45b3-b4f1-ca72b33089d8 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:16.900509 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2dc25d-9a50-45b3-b4f1-ca72b33089d8 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:16.900509 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2dc25d-9a50-45b3-b4f1-ca72b33089d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:16.911486 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:16.935516 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-ac2dc25d-9a50-45b3-b4f1-ca72b33089d8 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:44:16.937800 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-ac2dc25d-9a50-45b3-b4f1-ca72b33089d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:44:16.959841 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:16.973045 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646b1c7c-7e1c-4845-8931-6eb47eda43e0 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:17.023557 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a7d5e-d72f-4878-9a10-1ad966a4a1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:17.024397 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a7d5e-d72f-4878-9a10-1ad966a4a1c4 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:17.024841 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a7d5e-d72f-4878-9a10-1ad966a4a1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:17.025297 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a7d5e-d72f-4878-9a10-1ad966a4a1c4 None admin] PATH_INFO: `/v3/services` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:17.026425 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a7d5e-d72f-4878-9a10-1ad966a4a1c4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:17.026930 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a7d5e-d72f-4878-9a10-1ad966a4a1c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:17.029120 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a7d5e-d72f-4878-9a10-1ad966a4a1c4 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:17.043953 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 498/960] 10.222.0.15 () {56 vars in 1122 bytes} [Sun Sep 18 00:44:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:17.043953 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a7d5e-d72f-4878-9a10-1ad966a4a1c4 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:17.071980 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 463/961] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:44:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 00:44:17.071980 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2dc25d-9a50-45b3-b4f1-ca72b33089d8 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:17.258554 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a7d5e-d72f-4878-9a10-1ad966a4a1c4 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:17.287663 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2dc25d-9a50-45b3-b4f1-ca72b33089d8 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:17.341830 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6bca0-def2-4809-8a4b-f88d1cc876dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:17.343230 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6bca0-def2-4809-8a4b-f88d1cc876dc None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:17.345002 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6bca0-def2-4809-8a4b-f88d1cc876dc None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:17.345740 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6bca0-def2-4809-8a4b-f88d1cc876dc None admin] PATH_INFO: `/v3/domains` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:17.348040 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b6bca0-def2-4809-8a4b-f88d1cc876dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:17.349266 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b6bca0-def2-4809-8a4b-f88d1cc876dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:17.352229 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b6bca0-def2-4809-8a4b-f88d1cc876dc None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:17.362432 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d353d280-3029-47dd-a87d-fc3d1790af66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:17.363731 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d353d280-3029-47dd-a87d-fc3d1790af66 None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:17.364334 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d353d280-3029-47dd-a87d-fc3d1790af66 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:17.366730 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d353d280-3029-47dd-a87d-fc3d1790af66 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:17.368547 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d353d280-3029-47dd-a87d-fc3d1790af66 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:17.371165 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d353d280-3029-47dd-a87d-fc3d1790af66 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:17.380407 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:17.382433 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 499/962] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:44:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:17.388504 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6bca0-def2-4809-8a4b-f88d1cc876dc None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:17.422611 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 464/963] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Sep 18 00:44:17 2022] POST /identity/v3/endpoints => generated 349 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 00:44:17.427204 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:17.499055 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d353d280-3029-47dd-a87d-fc3d1790af66 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:17.616896 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6bca0-def2-4809-8a4b-f88d1cc876dc None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:17.704879 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971d062-4153-44b7-afcc-8bb25f77883a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:17.705873 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971d062-4153-44b7-afcc-8bb25f77883a None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:17.705873 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971d062-4153-44b7-afcc-8bb25f77883a None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:17.706188 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971d062-4153-44b7-afcc-8bb25f77883a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:17.716865 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a971d062-4153-44b7-afcc-8bb25f77883a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:17.717867 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a971d062-4153-44b7-afcc-8bb25f77883a None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:17.731812 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-a971d062-4153-44b7-afcc-8bb25f77883a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 18 00:44:17.731812 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:17.731812 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:44:17.731812 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:44:17.731812 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:44:17.731812 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:44:17.731812 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:44:17.731812 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:44:17.731812 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:44:17.731812 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:44:17.731812 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:44:17.731812 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:44:17.731812 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 00:44:17.731812 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 00:44:17.731812 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 00:44:17.731812 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 00:44:17.733733 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:44:17.733733 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:44:17.733733 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 00:44:17.733733 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:44:17.733733 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 00:44:17.733733 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:44:17.733733 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:44:17.733733 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:44:17.733733 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:44:17.733733 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:44:17.733733 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:44:17.733733 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:44:17.733733 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:44:17.733733 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:44:17.733733 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:44:17.733733 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:44:17.733733 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:44:17.733733 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:44:17.736326 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:44:17.736326 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:44:17.736326 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 00:44:17.736326 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 00:44:17.736326 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 00:44:17.736326 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 00:44:17.736326 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 00:44:17.736326 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 00:44:17.736326 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 18 00:44:17.736326 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:44:17.737474 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d353d280-3029-47dd-a87d-fc3d1790af66 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:17.737621 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 500/964] 10.222.0.15 () {56 vars in 1117 bytes} [Sun Sep 18 00:44:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:44:17.740768 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971d062-4153-44b7-afcc-8bb25f77883a None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:17.809970 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2146e8-0e8b-44da-a740-d689aaccd64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:17.810810 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2146e8-0e8b-44da-a740-d689aaccd64c None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:17.810951 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2146e8-0e8b-44da-a740-d689aaccd64c None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:17.811302 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2146e8-0e8b-44da-a740-d689aaccd64c None admin] PATH_INFO: `/v3/services/compute` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:17.811863 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2146e8-0e8b-44da-a740-d689aaccd64c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:17.813398 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2146e8-0e8b-44da-a740-d689aaccd64c None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:17.823642 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-6f2146e8-0e8b-44da-a740-d689aaccd64c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 18 00:44:17.823642 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:17.823642 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 18 00:44:17.823642 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 18 00:44:17.823642 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 18 00:44:17.823642 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 18 00:44:17.823642 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 18 00:44:17.823642 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 00:44:17.823642 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 18 00:44:17.823642 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:44:17.823642 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 18 00:44:17.823642 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:44:17.823642 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:17.823642 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:44:17.823642 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:44:17.823642 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:44:17.823642 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:44:17.825503 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:44:17.825503 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:44:17.825503 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:44:17.825503 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:44:17.825503 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:44:17.825503 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:44:17.825503 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 18 00:44:17.825503 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 18 00:44:17.825503 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 18 00:44:17.825503 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 18 00:44:17.825503 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:44:17.825503 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:44:17.825503 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:44:17.825503 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:44:17.825503 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:44:17.825503 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:44:17.827235 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:44:17.827235 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:44:17.827235 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:44:17.827235 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:44:17.827235 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:44:17.827235 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:44:17.827235 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:44:17.827235 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:44:17.827235 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:44:17.827235 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:44:17.827235 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 18 00:44:17.827235 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 00:44:17.827235 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 18 00:44:17.827235 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:44:17.827235 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 465/965] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Sep 18 00:44:17 2022] GET /identity/v3/services/compute => generated 88 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:44:17.831425 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2146e8-0e8b-44da-a740-d689aaccd64c None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:17.904190 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:17.928032 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:17.930036 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971d062-4153-44b7-afcc-8bb25f77883a None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:17.977628 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f7e90-0c6b-4ee0-a584-8b695740c4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:17.978740 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f7e90-0c6b-4ee0-a584-8b695740c4f8 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:17.979260 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f7e90-0c6b-4ee0-a584-8b695740c4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:17.979740 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f7e90-0c6b-4ee0-a584-8b695740c4f8 None admin] PATH_INFO: `/v3/users` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:17.980896 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8f7e90-0c6b-4ee0-a584-8b695740c4f8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:17.981425 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8f7e90-0c6b-4ee0-a584-8b695740c4f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:17.983513 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8f7e90-0c6b-4ee0-a584-8b695740c4f8 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:18.009134 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 501/966] 10.222.0.15 () {56 vars in 1149 bytes} [Sun Sep 18 00:44:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:18.018918 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f7e90-0c6b-4ee0-a584-8b695740c4f8 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:18.024801 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2146e8-0e8b-44da-a740-d689aaccd64c None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:18.091289 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28a7535-b40c-473b-956c-cdb40143f37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:18.092791 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a7535-b40c-473b-956c-cdb40143f37d None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:18.093606 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a7535-b40c-473b-956c-cdb40143f37d None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:18.094360 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a7535-b40c-473b-956c-cdb40143f37d None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:18.095714 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28a7535-b40c-473b-956c-cdb40143f37d None admin] RBAC: Adding query filter params (name=compute) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:18.096532 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28a7535-b40c-473b-956c-cdb40143f37d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:18.099935 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28a7535-b40c-473b-956c-cdb40143f37d None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:18.111464 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 466/967] 10.222.0.15 () {56 vars in 1112 bytes} [Sun Sep 18 00:44:17 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:18.120239 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28a7535-b40c-473b-956c-cdb40143f37d None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:18.230875 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f7e90-0c6b-4ee0-a584-8b695740c4f8 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:18.301662 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded8825-b710-4855-bc20-5fea34dbf6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:18.302579 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded8825-b710-4855-bc20-5fea34dbf6a8 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:18.302861 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded8825-b710-4855-bc20-5fea34dbf6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:18.303136 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded8825-b710-4855-bc20-5fea34dbf6a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:18.310310 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:18.324920 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28a7535-b40c-473b-956c-cdb40143f37d None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:18.360935 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:18.386009 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677bcb76-6040-433c-85bd-6d8ed4509eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:18.386655 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677bcb76-6040-433c-85bd-6d8ed4509eba None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:18.386939 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677bcb76-6040-433c-85bd-6d8ed4509eba None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:18.387214 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677bcb76-6040-433c-85bd-6d8ed4509eba None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:18.387868 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677bcb76-6040-433c-85bd-6d8ed4509eba None admin] RBAC: Adding query filter params (type=compute) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:18.388203 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677bcb76-6040-433c-85bd-6d8ed4509eba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:18.390323 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677bcb76-6040-433c-85bd-6d8ed4509eba None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:18.402099 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 467/968] 10.222.0.15 () {56 vars in 1112 bytes} [Sun Sep 18 00:44:18 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:44:18.431691 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eded8825-b710-4855-bc20-5fea34dbf6a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:18.433397 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eded8825-b710-4855-bc20-5fea34dbf6a8 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:18.536001 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769dd60-0f5a-4a46-a87d-523b0e0c2c30 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:18.536353 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769dd60-0f5a-4a46-a87d-523b0e0c2c30 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:18.536743 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769dd60-0f5a-4a46-a87d-523b0e0c2c30 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:18.539092 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 468/969] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:44:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 18 00:44:18.545636 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbdbcfe-034a-44a3-98f9-7db27794cbd6 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:18.546309 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbdbcfe-034a-44a3-98f9-7db27794cbd6 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:18.547340 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbdbcfe-034a-44a3-98f9-7db27794cbd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:18.568793 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-1dbdbcfe-034a-44a3-98f9-7db27794cbd6 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:44:18.570309 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-1dbdbcfe-034a-44a3-98f9-7db27794cbd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:44:18.573885 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 502/970] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Sep 18 00:44:18 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 18 00:44:18.582645 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded8825-b710-4855-bc20-5fea34dbf6a8 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:18.640155 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:18.680203 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 469/971] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:44:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 00:44:18.755337 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded8825-b710-4855-bc20-5fea34dbf6a8 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:18.820259 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71046700-fa2b-4562-855a-2b92c7b65507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:18.821646 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71046700-fa2b-4562-855a-2b92c7b65507 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:18.822333 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71046700-fa2b-4562-855a-2b92c7b65507 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:18.822996 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71046700-fa2b-4562-855a-2b92c7b65507 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:18.844045 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71046700-fa2b-4562-855a-2b92c7b65507 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:18.847084 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71046700-fa2b-4562-855a-2b92c7b65507 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:18.876872 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-71046700-fa2b-4562-855a-2b92c7b65507 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:44:18.876872 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:18.876872 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:44:18.876872 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:44:18.876872 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:44:18.876872 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:44:18.876872 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:44:18.876872 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:44:18.876872 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:44:18.876872 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:44:18.876872 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:44:18.876872 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:44:18.876872 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:44:18.876872 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:44:18.876872 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:44:18.876872 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:44:18.879033 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:44:18.879033 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:44:18.879033 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:44:18.879033 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:44:18.879033 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:44:18.879033 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:44:18.879033 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:44:18.879033 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:44:18.879033 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:44:18.879033 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:44:18.879033 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:44:18.879033 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:44:18.879033 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:44:18.879033 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:44:18.879033 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:44:18.879033 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:44:18.879033 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:44:18.881201 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:44:18.881201 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:44:18.881201 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:44:18.884243 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 503/972] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:44:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 00:44:18.891926 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbdbcfe-034a-44a3-98f9-7db27794cbd6 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:18.967102 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71046700-fa2b-4562-855a-2b92c7b65507 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:19.057912 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbdbcfe-034a-44a3-98f9-7db27794cbd6 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:19.076035 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:19.105163 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6182cb6-7f64-4afc-8eb3-6d6a1c96de5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:19.106167 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6182cb6-7f64-4afc-8eb3-6d6a1c96de5d None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:19.106654 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6182cb6-7f64-4afc-8eb3-6d6a1c96de5d None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:19.107160 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6182cb6-7f64-4afc-8eb3-6d6a1c96de5d None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:19.108086 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6182cb6-7f64-4afc-8eb3-6d6a1c96de5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:19.108638 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6182cb6-7f64-4afc-8eb3-6d6a1c96de5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:19.110829 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6182cb6-7f64-4afc-8eb3-6d6a1c96de5d None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:19.128760 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 470/973] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:44:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:19.130114 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6182cb6-7f64-4afc-8eb3-6d6a1c96de5d None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:19.141090 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:19.175026 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71046700-fa2b-4562-855a-2b92c7b65507 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:19.245781 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4ded24-5b07-489d-9287-29f3d0646174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:19.246488 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6182cb6-7f64-4afc-8eb3-6d6a1c96de5d None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:19.246836 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ded24-5b07-489d-9287-29f3d0646174 None admin] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:19.247322 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ded24-5b07-489d-9287-29f3d0646174 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:19.247807 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ded24-5b07-489d-9287-29f3d0646174 None admin] PATH_INFO: `/v3/users` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:19.249210 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4ded24-5b07-489d-9287-29f3d0646174 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:19.253051 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4ded24-5b07-489d-9287-29f3d0646174 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:19.279357 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.sql.core [None req-cc4ded24-5b07-489d-9287-29f3d0646174 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 18 00:44:19.279357 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 18 00:44:19.279357 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [parameters: {'user_id': '7ff3432e86b240248dcc19635751bc36', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 18 00:44:19.279357 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81571) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 18 00:44:19.291586 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73cffe0-0415-4956-9906-88ff378aff7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:19.292624 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73cffe0-0415-4956-9906-88ff378aff7f None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:19.293144 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73cffe0-0415-4956-9906-88ff378aff7f None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:19.293640 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73cffe0-0415-4956-9906-88ff378aff7f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:19.295179 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-cc4ded24-5b07-489d-9287-29f3d0646174 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 18 00:44:19.295179 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:19.295179 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 18 00:44:19.295179 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 18 00:44:19.295179 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 18 00:44:19.295179 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 18 00:44:19.295179 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 18 00:44:19.295179 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application result = self._query(query) Sep 18 00:44:19.295179 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 18 00:44:19.295179 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application conn.query(q) Sep 18 00:44:19.295179 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 18 00:44:19.295179 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 18 00:44:19.295179 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 18 00:44:19.295179 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application result.read() Sep 18 00:44:19.295179 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 18 00:44:19.296075 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 18 00:44:19.296075 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 18 00:44:19.296075 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 18 00:44:19.296075 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 18 00:44:19.296075 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 18 00:44:19.296075 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 18 00:44:19.296075 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 18 00:44:19.296075 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 18 00:44:19.296075 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:44:19.296075 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 18 00:44:19.296075 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:44:19.296075 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:19.296075 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 18 00:44:19.296075 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 18 00:44:19.296075 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 18 00:44:19.296075 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 18 00:44:19.296075 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 18 00:44:19.296075 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application next(self.gen) Sep 18 00:44:19.297539 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 18 00:44:19.297539 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application yield resource Sep 18 00:44:19.297539 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 18 00:44:19.297539 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application next(self.gen) Sep 18 00:44:19.297539 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 18 00:44:19.297539 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application self.session.rollback() Sep 18 00:44:19.297539 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 18 00:44:19.297539 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application self.force_reraise() Sep 18 00:44:19.297539 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 18 00:44:19.297539 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise self.value Sep 18 00:44:19.297539 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 18 00:44:19.297539 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 18 00:44:19.297539 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 18 00:44:19.297539 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application session.commit() Sep 18 00:44:19.297539 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 18 00:44:19.297539 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 18 00:44:19.297539 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 18 00:44:19.298455 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application self._prepare_impl() Sep 18 00:44:19.298455 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 18 00:44:19.298455 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application self.session.flush() Sep 18 00:44:19.298455 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 18 00:44:19.298455 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application self._flush(objects) Sep 18 00:44:19.298455 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 18 00:44:19.298455 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 18 00:44:19.298455 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 18 00:44:19.298455 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application compat.raise_( Sep 18 00:44:19.298455 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 18 00:44:19.298455 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception Sep 18 00:44:19.298455 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 18 00:44:19.298455 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application flush_context.execute() Sep 18 00:44:19.298455 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 18 00:44:19.298455 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rec.execute(self) Sep 18 00:44:19.298455 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 18 00:44:19.298455 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 18 00:44:19.299321 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 18 00:44:19.299321 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 18 00:44:19.299321 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 18 00:44:19.299321 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 18 00:44:19.299321 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 18 00:44:19.299321 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 18 00:44:19.299321 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 18 00:44:19.299321 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 18 00:44:19.299321 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 18 00:44:19.299321 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 18 00:44:19.299321 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 18 00:44:19.299321 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 18 00:44:19.299321 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 18 00:44:19.299321 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 18 00:44:19.299321 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 18 00:44:19.299321 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception Sep 18 00:44:19.305718 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 18 00:44:19.305718 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 18 00:44:19.305718 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 18 00:44:19.305718 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 18 00:44:19.305718 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 18 00:44:19.305718 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application result = self._query(query) Sep 18 00:44:19.305718 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 18 00:44:19.305718 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application conn.query(q) Sep 18 00:44:19.305718 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 18 00:44:19.305718 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 18 00:44:19.305718 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 18 00:44:19.305718 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application result.read() Sep 18 00:44:19.305718 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 18 00:44:19.305718 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 18 00:44:19.305718 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 18 00:44:19.305718 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 18 00:44:19.307737 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 18 00:44:19.307737 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 18 00:44:19.307737 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 18 00:44:19.307737 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 18 00:44:19.307737 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 18 00:44:19.307737 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 18 00:44:19.307737 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [parameters: {'user_id': '7ff3432e86b240248dcc19635751bc36', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 18 00:44:19.307737 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 18 00:44:19.307737 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:44:19.307737 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 18 00:44:19.307737 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:44:19.307737 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:19.307737 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:44:19.307737 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:44:19.307737 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:44:19.310467 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:44:19.310467 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:44:19.310467 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:44:19.310467 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:44:19.310467 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:44:19.310467 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:44:19.310467 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:44:19.310467 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 18 00:44:19.310467 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 18 00:44:19.310467 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:44:19.310467 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:44:19.310467 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 00:44:19.310467 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:44:19.310467 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 00:44:19.310467 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:44:19.310467 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 18 00:44:19.310467 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 18 00:44:19.313285 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 18 00:44:19.313285 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 18 00:44:19.313285 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 18 00:44:19.313285 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 18 00:44:19.313285 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 18 00:44:19.313285 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:44:19.313285 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 504/974] 10.222.0.15 () {60 vars in 1131 bytes} [Sun Sep 18 00:44:18 2022] POST /identity/v3/users => generated 160 bytes in 331 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:44:19.314223 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73cffe0-0415-4956-9906-88ff378aff7f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:19.315041 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4ded24-5b07-489d-9287-29f3d0646174 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:19.318268 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73cffe0-0415-4956-9906-88ff378aff7f None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:19.335712 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-b73cffe0-0415-4956-9906-88ff378aff7f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:44:19.335712 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:19.335712 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:44:19.335712 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:44:19.335712 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:44:19.335712 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:44:19.335712 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:44:19.335712 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:44:19.335712 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:44:19.335712 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:44:19.335712 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:44:19.335712 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:44:19.335712 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 00:44:19.335712 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 00:44:19.335712 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 00:44:19.336868 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 00:44:19.336868 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:44:19.336868 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:44:19.336868 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:44:19.336868 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:44:19.336868 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:44:19.336868 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:44:19.336868 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:44:19.336868 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:44:19.336868 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:44:19.336868 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:44:19.336868 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:44:19.336868 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:44:19.336868 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:44:19.336868 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:44:19.336868 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:44:19.336868 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:44:19.337757 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 00:44:19.337757 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 00:44:19.337757 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 00:44:19.337757 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 00:44:19.337757 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 00:44:19.337757 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 00:44:19.337757 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:44:19.337757 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:44:19.339933 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 471/975] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Sep 18 00:44:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:44:19.349596 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73cffe0-0415-4956-9906-88ff378aff7f None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:19.414283 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:19.523249 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4ded24-5b07-489d-9287-29f3d0646174 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:19.554977 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73cffe0-0415-4956-9906-88ff378aff7f None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:19.590968 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851de9f1-c2e5-488b-815c-a52f7f0ea22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:19.591999 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851de9f1-c2e5-488b-815c-a52f7f0ea22c None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:19.592502 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851de9f1-c2e5-488b-815c-a52f7f0ea22c None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:19.592987 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851de9f1-c2e5-488b-815c-a52f7f0ea22c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:19.609786 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851de9f1-c2e5-488b-815c-a52f7f0ea22c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:19.613200 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851de9f1-c2e5-488b-815c-a52f7f0ea22c None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:19.626123 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67003c01-5e4d-42b0-8aba-1da3f78b7089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:19.627646 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67003c01-5e4d-42b0-8aba-1da3f78b7089 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:19.628442 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67003c01-5e4d-42b0-8aba-1da3f78b7089 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:19.629190 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67003c01-5e4d-42b0-8aba-1da3f78b7089 None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:19.630725 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67003c01-5e4d-42b0-8aba-1da3f78b7089 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:19.631549 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67003c01-5e4d-42b0-8aba-1da3f78b7089 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:19.634595 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67003c01-5e4d-42b0-8aba-1da3f78b7089 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:19.638230 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-851de9f1-c2e5-488b-815c-a52f7f0ea22c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 18 00:44:19.638230 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:19.638230 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:44:19.638230 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:44:19.638230 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:44:19.638230 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:44:19.638230 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:44:19.638230 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:44:19.638230 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:44:19.638230 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:44:19.638230 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:44:19.638230 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:44:19.638230 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 00:44:19.638230 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 00:44:19.638230 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 00:44:19.638230 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 00:44:19.640150 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:44:19.640150 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:44:19.640150 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 00:44:19.640150 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:44:19.640150 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 00:44:19.640150 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:44:19.640150 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:44:19.640150 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:44:19.640150 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:44:19.640150 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:44:19.640150 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:44:19.640150 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:44:19.640150 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:44:19.640150 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:44:19.640150 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:44:19.640150 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:44:19.640150 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:44:19.640150 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:44:19.642033 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:44:19.642033 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:44:19.642033 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 00:44:19.642033 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 00:44:19.642033 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 00:44:19.642033 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 00:44:19.642033 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 00:44:19.642033 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 00:44:19.642033 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 18 00:44:19.642033 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:44:19.644398 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 505/976] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Sep 18 00:44:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:44:19.651048 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851de9f1-c2e5-488b-815c-a52f7f0ea22c None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:19.673322 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 472/977] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Sep 18 00:44:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:44:19.674453 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:19.680148 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67003c01-5e4d-42b0-8aba-1da3f78b7089 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:19.865170 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851de9f1-c2e5-488b-815c-a52f7f0ea22c None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:19.871156 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:19.896478 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67003c01-5e4d-42b0-8aba-1da3f78b7089 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:19.935530 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3212cb4-d675-4144-99d9-67b8a71420bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:19.936560 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3212cb4-d675-4144-99d9-67b8a71420bd None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:19.937024 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3212cb4-d675-4144-99d9-67b8a71420bd None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:19.937556 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3212cb4-d675-4144-99d9-67b8a71420bd None admin] PATH_INFO: `/v3/users` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:19.938793 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3212cb4-d675-4144-99d9-67b8a71420bd None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:19.939322 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3212cb4-d675-4144-99d9-67b8a71420bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:19.941976 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3212cb4-d675-4144-99d9-67b8a71420bd None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:19.954439 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d1acc-2ef6-4888-ab3f-c610976fbbc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:19.955349 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d1acc-2ef6-4888-ab3f-c610976fbbc0 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:19.955776 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d1acc-2ef6-4888-ab3f-c610976fbbc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:19.956229 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d1acc-2ef6-4888-ab3f-c610976fbbc0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:19.957106 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15d1acc-2ef6-4888-ab3f-c610976fbbc0 None admin] RBAC: Adding query filter params (role.id=5e489759b2bc48d6b3895ed9d1f79f19, scope.project.id=52ebde8fa3f84ede9ef575f7c0780798, user.id=9afbb5a9f364495ca55089dd6ddd7934) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:19.957579 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15d1acc-2ef6-4888-ab3f-c610976fbbc0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:19.959165 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15d1acc-2ef6-4888-ab3f-c610976fbbc0 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:19.965901 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 473/978] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Sep 18 00:44:19 2022] GET /identity/v3/role_assignments?user.id=9afbb5a9f364495ca55089dd6ddd7934&scope.project.id=52ebde8fa3f84ede9ef575f7c0780798&role.id=5e489759b2bc48d6b3895ed9d1f79f19 => generated 608 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:19.967356 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e50e9f-8a7b-4bf7-ae42-2112d525606f None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:19.967792 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e50e9f-8a7b-4bf7-ae42-2112d525606f None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:19.968261 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e50e9f-8a7b-4bf7-ae42-2112d525606f None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:19.970043 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 474/979] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:44:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:44:19.980609 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492e7eb-8e68-41a4-88eb-1d43642bb310 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:19.981103 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492e7eb-8e68-41a4-88eb-1d43642bb310 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:19.981589 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492e7eb-8e68-41a4-88eb-1d43642bb310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:20.015934 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 506/980] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Sep 18 00:44:19 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:20.018567 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-9492e7eb-8e68-41a4-88eb-1d43642bb310 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:44:20.020978 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-9492e7eb-8e68-41a4-88eb-1d43642bb310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:44:20.172197 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 475/981] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:44:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 00:44:20.614490 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3212cb4-d675-4144-99d9-67b8a71420bd None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:20.725934 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:20.768363 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3212cb4-d675-4144-99d9-67b8a71420bd None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:20.834077 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4500d78-26d4-43a1-8278-fc5699dfeeee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:20.835168 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4500d78-26d4-43a1-8278-fc5699dfeeee None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:20.835660 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4500d78-26d4-43a1-8278-fc5699dfeeee None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:20.836377 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4500d78-26d4-43a1-8278-fc5699dfeeee None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:20.837460 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4500d78-26d4-43a1-8278-fc5699dfeeee None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:20.840251 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4500d78-26d4-43a1-8278-fc5699dfeeee None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:20.866940 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-f4500d78-26d4-43a1-8278-fc5699dfeeee None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 18 00:44:20.866940 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:20.866940 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 18 00:44:20.866940 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 18 00:44:20.866940 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 18 00:44:20.866940 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 18 00:44:20.866940 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 18 00:44:20.866940 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 00:44:20.866940 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 18 00:44:20.866940 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:44:20.866940 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 18 00:44:20.866940 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:44:20.866940 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:20.866940 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:44:20.866940 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:44:20.866940 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:44:20.866940 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:44:20.868257 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:44:20.868257 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:44:20.868257 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:44:20.868257 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:44:20.868257 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:44:20.868257 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:44:20.868257 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 18 00:44:20.868257 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 18 00:44:20.868257 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 18 00:44:20.868257 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 18 00:44:20.868257 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:44:20.868257 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:44:20.868257 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:44:20.868257 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:44:20.868257 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:44:20.868257 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:44:20.869157 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:44:20.869157 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:44:20.869157 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:44:20.869157 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:44:20.869157 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:44:20.869157 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:44:20.869157 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:44:20.869157 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:44:20.869157 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:44:20.869157 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:44:20.869157 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 18 00:44:20.869157 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 00:44:20.869157 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 18 00:44:20.869157 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:44:20.873278 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 507/982] 10.222.0.15 () {56 vars in 1126 bytes} [Sun Sep 18 00:44:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:44:20.878252 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9492e7eb-8e68-41a4-88eb-1d43642bb310 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:20.987323 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:21.009610 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9492e7eb-8e68-41a4-88eb-1d43642bb310 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:21.053108 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064fc11a-30ef-41bd-a734-502658022246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:21.053931 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064fc11a-30ef-41bd-a734-502658022246 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:21.054349 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064fc11a-30ef-41bd-a734-502658022246 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:21.054807 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064fc11a-30ef-41bd-a734-502658022246 None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:21.055612 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064fc11a-30ef-41bd-a734-502658022246 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:21.056102 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064fc11a-30ef-41bd-a734-502658022246 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:21.057781 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064fc11a-30ef-41bd-a734-502658022246 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:21.069602 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 476/983] 10.222.0.15 () {56 vars in 1122 bytes} [Sun Sep 18 00:44:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:44:21.071043 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4500d78-26d4-43a1-8278-fc5699dfeeee None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:21.241721 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4500d78-26d4-43a1-8278-fc5699dfeeee None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:21.296551 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:21.305650 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368ad456-7392-4e1f-9eeb-c640a6e9b02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:21.306286 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ad456-7392-4e1f-9eeb-c640a6e9b02d None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:21.306564 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ad456-7392-4e1f-9eeb-c640a6e9b02d None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:21.306827 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ad456-7392-4e1f-9eeb-c640a6e9b02d None admin] PATH_INFO: `/v3/services` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:21.307481 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368ad456-7392-4e1f-9eeb-c640a6e9b02d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:21.307777 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368ad456-7392-4e1f-9eeb-c640a6e9b02d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:21.309212 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368ad456-7392-4e1f-9eeb-c640a6e9b02d None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:21.316206 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 508/984] 10.222.0.15 () {56 vars in 1122 bytes} [Sun Sep 18 00:44:21 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:21.322856 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064fc11a-30ef-41bd-a734-502658022246 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:21.481250 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064fc11a-30ef-41bd-a734-502658022246 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:21.524647 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8679e5-738f-42d8-a834-dae09c336104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:21.525169 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8679e5-738f-42d8-a834-dae09c336104 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:21.525447 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8679e5-738f-42d8-a834-dae09c336104 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:21.525718 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8679e5-738f-42d8-a834-dae09c336104 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:21.526455 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8679e5-738f-42d8-a834-dae09c336104 None admin] RBAC: Adding query filter params (interface=admin, service_id=a1f4d4032e104d26b87e7273f68fb41e, region_id=RegionOne) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:21.526767 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8679e5-738f-42d8-a834-dae09c336104 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:21.528235 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8679e5-738f-42d8-a834-dae09c336104 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:21.535475 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 477/985] 10.222.0.15 () {56 vars in 1249 bytes} [Sun Sep 18 00:44:21 2022] GET /identity/v3/endpoints?service_id=a1f4d4032e104d26b87e7273f68fb41e&interface=admin®ion_id=RegionOne => generated 193 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:21.542276 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368ad456-7392-4e1f-9eeb-c640a6e9b02d None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:21.717877 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368ad456-7392-4e1f-9eeb-c640a6e9b02d None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:21.780254 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1918d853-cc3d-463b-9d6a-80090c02bc2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:21.781259 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918d853-cc3d-463b-9d6a-80090c02bc2d None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:21.781764 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918d853-cc3d-463b-9d6a-80090c02bc2d None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:21.782229 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918d853-cc3d-463b-9d6a-80090c02bc2d None admin] PATH_INFO: `/v3/services` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:21.783357 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1918d853-cc3d-463b-9d6a-80090c02bc2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:21.786055 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1918d853-cc3d-463b-9d6a-80090c02bc2d None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:21.803996 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 509/986] 10.222.0.15 () {56 vars in 1087 bytes} [Sun Sep 18 00:44:21 2022] GET /identity/v3/services => generated 1497 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 18 00:44:22.163396 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a14014e-ff1b-4ed4-8506-8d53be3c88e5 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:22.163967 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a14014e-ff1b-4ed4-8506-8d53be3c88e5 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:22.164332 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a14014e-ff1b-4ed4-8506-8d53be3c88e5 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:22.167314 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 478/987] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:44:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:44:22.176317 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b652e05-f5b1-428f-bc88-e52281d67380 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:22.177114 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b652e05-f5b1-428f-bc88-e52281d67380 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:22.177338 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b652e05-f5b1-428f-bc88-e52281d67380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:22.208563 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-7b652e05-f5b1-428f-bc88-e52281d67380 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:44:22.211170 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-7b652e05-f5b1-428f-bc88-e52281d67380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:44:22.319268 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:22.345266 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 510/988] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:44:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 00:44:22.860004 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a14014e-ff1b-4ed4-8506-8d53be3c88e5 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:22.880555 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:22.993158 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a14014e-ff1b-4ed4-8506-8d53be3c88e5 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:23.038967 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e4a6d-433a-44cd-a31e-15c66f8741f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:23.039847 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e4a6d-433a-44cd-a31e-15c66f8741f6 None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:23.040214 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e4a6d-433a-44cd-a31e-15c66f8741f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:23.040511 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e4a6d-433a-44cd-a31e-15c66f8741f6 None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:23.041422 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e4a6d-433a-44cd-a31e-15c66f8741f6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:23.042803 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e4a6d-433a-44cd-a31e-15c66f8741f6 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:23.063943 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 479/989] 10.222.0.15 () {60 vars in 1141 bytes} [Sun Sep 18 00:44:22 2022] POST /identity/v3/services => generated 242 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 00:44:23.124469 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7030344-c1c3-4e1d-8039-1ee930f6d399 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:23.124741 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7030344-c1c3-4e1d-8039-1ee930f6d399 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:23.124950 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7030344-c1c3-4e1d-8039-1ee930f6d399 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:23.127065 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 511/990] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:44:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:44:23.132841 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb32179-2e62-4134-8ac3-5e0131ce210a None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:23.133225 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb32179-2e62-4134-8ac3-5e0131ce210a None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:23.133413 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb32179-2e62-4134-8ac3-5e0131ce210a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:23.154182 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-6eb32179-2e62-4134-8ac3-5e0131ce210a None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:44:23.155414 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-6eb32179-2e62-4134-8ac3-5e0131ce210a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:44:23.248177 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:23.264099 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 480/991] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:44:23 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 00:44:23.542378 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7030344-c1c3-4e1d-8039-1ee930f6d399 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:23.709341 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7030344-c1c3-4e1d-8039-1ee930f6d399 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:23.758623 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0b673e-279a-4f25-a430-62637c256d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:23.759555 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b673e-279a-4f25-a430-62637c256d11 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:23.760082 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b673e-279a-4f25-a430-62637c256d11 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:23.760584 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b673e-279a-4f25-a430-62637c256d11 None admin] PATH_INFO: `/v3/services/image` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:23.761641 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0b673e-279a-4f25-a430-62637c256d11 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:23.764344 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0b673e-279a-4f25-a430-62637c256d11 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:23.781496 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-2b0b673e-279a-4f25-a430-62637c256d11 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 18 00:44:23.781496 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:23.781496 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 18 00:44:23.781496 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 18 00:44:23.781496 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 18 00:44:23.781496 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 18 00:44:23.781496 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 18 00:44:23.781496 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 00:44:23.781496 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 18 00:44:23.781496 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:44:23.781496 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 18 00:44:23.781496 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:44:23.781496 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:23.781496 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:44:23.781496 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:44:23.781496 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:44:23.781496 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:44:23.783461 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:44:23.783461 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:44:23.783461 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:44:23.783461 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:44:23.783461 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:44:23.783461 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:44:23.783461 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 18 00:44:23.783461 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 18 00:44:23.783461 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 18 00:44:23.783461 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 18 00:44:23.783461 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:44:23.783461 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:44:23.783461 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:44:23.783461 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:44:23.783461 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:44:23.783461 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:44:23.785137 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:44:23.785137 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:44:23.785137 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:44:23.785137 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:44:23.785137 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:44:23.785137 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:44:23.785137 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:44:23.785137 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:44:23.785137 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:44:23.785137 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:44:23.785137 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 18 00:44:23.785137 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 00:44:23.785137 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 18 00:44:23.785137 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:44:23.785137 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 512/992] 10.222.0.15 () {56 vars in 1105 bytes} [Sun Sep 18 00:44:23 2022] GET /identity/v3/services/image => generated 86 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 00:44:23.791167 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb32179-2e62-4134-8ac3-5e0131ce210a None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:23.964578 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb32179-2e62-4134-8ac3-5e0131ce210a None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:24.017582 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4301371-a199-4fd9-a611-82342f50a971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:24.018571 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4301371-a199-4fd9-a611-82342f50a971 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:24.019025 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4301371-a199-4fd9-a611-82342f50a971 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:24.019500 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4301371-a199-4fd9-a611-82342f50a971 None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:24.020767 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4301371-a199-4fd9-a611-82342f50a971 None admin] RBAC: Adding query filter params (name=image) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:24.021094 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4301371-a199-4fd9-a611-82342f50a971 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:24.023947 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4301371-a199-4fd9-a611-82342f50a971 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:24.038406 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 481/993] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:44:23 2022] GET /identity/v3/services?name=image => generated 122 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:24.040447 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0b673e-279a-4f25-a430-62637c256d11 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:24.050167 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe26a66-8fad-4e8b-9a66-faca931e99dc None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:24.057177 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe26a66-8fad-4e8b-9a66-faca931e99dc None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:24.057530 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe26a66-8fad-4e8b-9a66-faca931e99dc None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:24.059054 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 482/994] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:44:24 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:44:24.069713 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f66bf-b41c-4215-8b8e-1b67a1f19f34 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:24.069713 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f66bf-b41c-4215-8b8e-1b67a1f19f34 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:24.069713 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f66bf-b41c-4215-8b8e-1b67a1f19f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:24.110301 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-f39f66bf-b41c-4215-8b8e-1b67a1f19f34 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:44:24.112341 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-f39f66bf-b41c-4215-8b8e-1b67a1f19f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:44:24.128707 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:24.192334 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0b673e-279a-4f25-a430-62637c256d11 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:24.217816 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:24.228697 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 483/995] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:44:24 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 00:44:24.244940 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02439a7c-c88a-4542-8b28-9006ba03177f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:24.245795 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02439a7c-c88a-4542-8b28-9006ba03177f None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:24.246240 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02439a7c-c88a-4542-8b28-9006ba03177f None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:24.246678 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02439a7c-c88a-4542-8b28-9006ba03177f None admin] PATH_INFO: `/v3/services` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:24.247496 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02439a7c-c88a-4542-8b28-9006ba03177f None admin] RBAC: Adding query filter params (type=image) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:24.248010 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02439a7c-c88a-4542-8b28-9006ba03177f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:24.249849 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02439a7c-c88a-4542-8b28-9006ba03177f None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:24.263984 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 513/996] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:44:24 2022] GET /identity/v3/services?type=image => generated 122 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:24.740346 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f66bf-b41c-4215-8b8e-1b67a1f19f34 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:24.866181 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f66bf-b41c-4215-8b8e-1b67a1f19f34 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:24.904047 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a9b252-c975-4f40-9b4b-b6d51484e092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:24.904689 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a9b252-c975-4f40-9b4b-b6d51484e092 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:24.904963 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a9b252-c975-4f40-9b4b-b6d51484e092 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:24.905236 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a9b252-c975-4f40-9b4b-b6d51484e092 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:24.906353 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a9b252-c975-4f40-9b4b-b6d51484e092 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:24.907854 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a9b252-c975-4f40-9b4b-b6d51484e092 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:24.917801 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-c6a9b252-c975-4f40-9b4b-b6d51484e092 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 18 00:44:24.917801 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:24.917801 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 18 00:44:24.917801 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 18 00:44:24.917801 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 18 00:44:24.917801 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 18 00:44:24.917801 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 18 00:44:24.917801 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 00:44:24.917801 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 18 00:44:24.917801 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:44:24.917801 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 18 00:44:24.917801 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:44:24.917801 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:24.917801 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:44:24.917801 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:44:24.917801 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:44:24.917801 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:44:24.919734 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:44:24.919734 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:44:24.919734 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:44:24.919734 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:44:24.919734 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:44:24.919734 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:44:24.919734 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 18 00:44:24.919734 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 18 00:44:24.919734 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 18 00:44:24.919734 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 18 00:44:24.919734 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:44:24.919734 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:44:24.919734 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:44:24.919734 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:44:24.919734 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:44:24.919734 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:44:24.922010 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:44:24.922010 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:44:24.922010 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:44:24.922010 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:44:24.922010 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:44:24.922010 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:44:24.922010 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:44:24.922010 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:44:24.922010 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:44:24.922010 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:44:24.922010 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 18 00:44:24.922010 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 00:44:24.922010 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 18 00:44:24.922010 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:44:24.924165 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 484/997] 10.222.0.15 () {56 vars in 1126 bytes} [Sun Sep 18 00:44:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 00:44:24.925648 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02439a7c-c88a-4542-8b28-9006ba03177f None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:25.047501 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02439a7c-c88a-4542-8b28-9006ba03177f None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:25.068461 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:25.101394 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23951157-eec0-49ff-bcc6-66c4a85cfc1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:25.102424 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23951157-eec0-49ff-bcc6-66c4a85cfc1d None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:25.102915 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23951157-eec0-49ff-bcc6-66c4a85cfc1d None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:25.103408 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23951157-eec0-49ff-bcc6-66c4a85cfc1d None admin] PATH_INFO: `/v3/services` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:25.104579 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23951157-eec0-49ff-bcc6-66c4a85cfc1d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:25.105123 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23951157-eec0-49ff-bcc6-66c4a85cfc1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:25.107666 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23951157-eec0-49ff-bcc6-66c4a85cfc1d None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:25.122007 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 514/998] 10.222.0.15 () {56 vars in 1122 bytes} [Sun Sep 18 00:44:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:44:25.123684 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a9b252-c975-4f40-9b4b-b6d51484e092 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:25.195065 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:25.243382 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a9b252-c975-4f40-9b4b-b6d51484e092 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:25.285961 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc18e84-18a6-4df4-92d9-3e106cc47d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:25.286606 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc18e84-18a6-4df4-92d9-3e106cc47d31 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:25.286880 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc18e84-18a6-4df4-92d9-3e106cc47d31 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:25.287149 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc18e84-18a6-4df4-92d9-3e106cc47d31 None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:25.287789 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc18e84-18a6-4df4-92d9-3e106cc47d31 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:25.288133 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc18e84-18a6-4df4-92d9-3e106cc47d31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:25.289556 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc18e84-18a6-4df4-92d9-3e106cc47d31 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:25.295330 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 485/999] 10.222.0.15 () {56 vars in 1122 bytes} [Sun Sep 18 00:44:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:25.304347 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23951157-eec0-49ff-bcc6-66c4a85cfc1d None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:25.430504 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23951157-eec0-49ff-bcc6-66c4a85cfc1d None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:25.470625 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e56e64-f514-4d09-9f46-fdb9cfc8e76f None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:25.470877 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e56e64-f514-4d09-9f46-fdb9cfc8e76f None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:25.471209 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e56e64-f514-4d09-9f46-fdb9cfc8e76f None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:25.473078 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 486/1000] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:44:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 18 00:44:25.473723 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838c461-c535-4d8a-a530-d42c02e0530b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:25.474780 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838c461-c535-4d8a-a530-d42c02e0530b None admin] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:25.475278 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838c461-c535-4d8a-a530-d42c02e0530b None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:25.475762 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838c461-c535-4d8a-a530-d42c02e0530b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:25.477115 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1838c461-c535-4d8a-a530-d42c02e0530b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:25.478004 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32208fc9-8464-43e5-88ae-b891ede8c04c None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:25.478295 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32208fc9-8464-43e5-88ae-b891ede8c04c None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:25.478573 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32208fc9-8464-43e5-88ae-b891ede8c04c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:25.479468 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1838c461-c535-4d8a-a530-d42c02e0530b None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:25.497779 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-32208fc9-8464-43e5-88ae-b891ede8c04c None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:44:25.498998 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-32208fc9-8464-43e5-88ae-b891ede8c04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:44:25.507200 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 515/1001] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Sep 18 00:44:25 2022] POST /identity/v3/endpoints => generated 325 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 00:44:25.589607 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 487/1002] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:44:25 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 18 00:44:25.861486 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838c461-c535-4d8a-a530-d42c02e0530b None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:25.938773 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:26.047785 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838c461-c535-4d8a-a530-d42c02e0530b None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:26.108821 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7754d4e-5e3d-4f9d-bd7e-cb02329f0376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:26.109898 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7754d4e-5e3d-4f9d-bd7e-cb02329f0376 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:26.110399 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7754d4e-5e3d-4f9d-bd7e-cb02329f0376 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:26.110892 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7754d4e-5e3d-4f9d-bd7e-cb02329f0376 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:26.112024 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7754d4e-5e3d-4f9d-bd7e-cb02329f0376 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:26.114566 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7754d4e-5e3d-4f9d-bd7e-cb02329f0376 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:26.131627 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-d7754d4e-5e3d-4f9d-bd7e-cb02329f0376 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 18 00:44:26.131627 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:26.131627 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 18 00:44:26.131627 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 18 00:44:26.131627 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 18 00:44:26.131627 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 18 00:44:26.131627 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 18 00:44:26.131627 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 00:44:26.131627 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 18 00:44:26.131627 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:44:26.131627 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 18 00:44:26.131627 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:44:26.131627 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:26.131627 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:44:26.131627 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:44:26.131627 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:44:26.131627 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:44:26.132785 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:44:26.132785 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:44:26.132785 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:44:26.132785 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:44:26.132785 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:44:26.132785 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:44:26.132785 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 18 00:44:26.132785 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 18 00:44:26.132785 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 18 00:44:26.132785 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 18 00:44:26.132785 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:44:26.132785 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:44:26.132785 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:44:26.132785 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:44:26.132785 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:44:26.132785 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:44:26.133638 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:44:26.133638 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:44:26.133638 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:44:26.133638 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:44:26.133638 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:44:26.133638 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:44:26.133638 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:44:26.133638 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:44:26.133638 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:44:26.133638 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:44:26.133638 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 18 00:44:26.133638 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 00:44:26.133638 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 18 00:44:26.133638 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:44:26.138040 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 516/1003] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Sep 18 00:44:25 2022] GET /identity/v3/services/compute => generated 88 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:44:26.141071 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32208fc9-8464-43e5-88ae-b891ede8c04c None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:26.230808 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:26.292958 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32208fc9-8464-43e5-88ae-b891ede8c04c None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:26.333940 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98af68b-43da-4f41-a992-64e203aecb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:26.334565 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98af68b-43da-4f41-a992-64e203aecb8b None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:26.334839 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98af68b-43da-4f41-a992-64e203aecb8b None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:26.335158 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98af68b-43da-4f41-a992-64e203aecb8b None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:26.335811 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98af68b-43da-4f41-a992-64e203aecb8b None admin] RBAC: Adding query filter params (name=compute) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:26.336142 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98af68b-43da-4f41-a992-64e203aecb8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:26.337535 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98af68b-43da-4f41-a992-64e203aecb8b None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:26.343625 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 488/1004] 10.222.0.15 () {56 vars in 1112 bytes} [Sun Sep 18 00:44:26 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:26.350039 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7754d4e-5e3d-4f9d-bd7e-cb02329f0376 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:26.559351 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7754d4e-5e3d-4f9d-bd7e-cb02329f0376 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:26.563482 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:26.573222 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5020b01-3a4b-4cdf-909e-bd01a45a935f None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:26.573506 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5020b01-3a4b-4cdf-909e-bd01a45a935f None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:26.573797 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5020b01-3a4b-4cdf-909e-bd01a45a935f None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:26.575527 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 489/1005] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:44:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:44:26.581829 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8684d779-8df1-46b3-a8ad-b275058d2073 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:26.582126 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8684d779-8df1-46b3-a8ad-b275058d2073 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:26.582373 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8684d779-8df1-46b3-a8ad-b275058d2073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:26.604477 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-8684d779-8df1-46b3-a8ad-b275058d2073 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:44:26.605789 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-8684d779-8df1-46b3-a8ad-b275058d2073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:44:26.613328 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c06e97-3478-4a91-b8cb-7d0ff5391ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:26.613993 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c06e97-3478-4a91-b8cb-7d0ff5391ad7 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:26.614273 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c06e97-3478-4a91-b8cb-7d0ff5391ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:26.614598 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c06e97-3478-4a91-b8cb-7d0ff5391ad7 None admin] PATH_INFO: `/v3/services` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:26.615781 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c06e97-3478-4a91-b8cb-7d0ff5391ad7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:26.615781 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c06e97-3478-4a91-b8cb-7d0ff5391ad7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:26.616963 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c06e97-3478-4a91-b8cb-7d0ff5391ad7 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:26.622368 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 517/1006] 10.222.0.15 () {56 vars in 1112 bytes} [Sun Sep 18 00:44:26 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:44:26.629076 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c06e97-3478-4a91-b8cb-7d0ff5391ad7 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:26.704662 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 490/1007] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:44:26 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 18 00:44:26.770214 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c06e97-3478-4a91-b8cb-7d0ff5391ad7 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:26.823684 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41408faf-a094-484b-8fa9-9a47bd0ca94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:26.824522 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41408faf-a094-484b-8fa9-9a47bd0ca94a None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:26.824854 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41408faf-a094-484b-8fa9-9a47bd0ca94a None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:26.825117 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41408faf-a094-484b-8fa9-9a47bd0ca94a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:26.826087 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41408faf-a094-484b-8fa9-9a47bd0ca94a None admin] RBAC: Adding query filter params (interface=public, service_id=56a9f380e7c54aa4ac9ca4bbb65b6559, region_id=RegionOne) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:26.826578 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41408faf-a094-484b-8fa9-9a47bd0ca94a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:26.828913 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41408faf-a094-484b-8fa9-9a47bd0ca94a None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:26.837121 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 518/1008] 10.222.0.15 () {56 vars in 1251 bytes} [Sun Sep 18 00:44:26 2022] GET /identity/v3/endpoints?service_id=56a9f380e7c54aa4ac9ca4bbb65b6559&interface=public®ion_id=RegionOne => generated 194 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:44:26.843500 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8684d779-8df1-46b3-a8ad-b275058d2073 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:26.898454 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:26.964543 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8684d779-8df1-46b3-a8ad-b275058d2073 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:26.979657 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41408faf-a094-484b-8fa9-9a47bd0ca94a None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:27.018878 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:27.022553 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8095f1-1a86-45c3-aa2f-a914592f2bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:27.023510 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8095f1-1a86-45c3-aa2f-a914592f2bb7 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:27.024037 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8095f1-1a86-45c3-aa2f-a914592f2bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:27.024510 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8095f1-1a86-45c3-aa2f-a914592f2bb7 None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:27.025577 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8095f1-1a86-45c3-aa2f-a914592f2bb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:27.028244 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8095f1-1a86-45c3-aa2f-a914592f2bb7 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:27.041570 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 491/1009] 10.222.0.15 () {56 vars in 1087 bytes} [Sun Sep 18 00:44:26 2022] GET /identity/v3/services => generated 1727 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 00:44:27.147532 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41408faf-a094-484b-8fa9-9a47bd0ca94a None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:27.211511 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff0ba8-e038-4c78-8d7a-6857048b04e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:27.212560 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff0ba8-e038-4c78-8d7a-6857048b04e4 None admin] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:27.212990 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff0ba8-e038-4c78-8d7a-6857048b04e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:27.213393 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff0ba8-e038-4c78-8d7a-6857048b04e4 None admin] PATH_INFO: `/v3/services` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:27.214474 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dff0ba8-e038-4c78-8d7a-6857048b04e4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:27.216861 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dff0ba8-e038-4c78-8d7a-6857048b04e4 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:27.239758 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 519/1010] 10.222.0.15 () {60 vars in 1141 bytes} [Sun Sep 18 00:44:26 2022] POST /identity/v3/services => generated 242 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 00:44:27.842565 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc31c3-f4c3-4ddc-9df8-1ffb1dec41a2 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:27.843210 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc31c3-f4c3-4ddc-9df8-1ffb1dec41a2 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:27.843210 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc31c3-f4c3-4ddc-9df8-1ffb1dec41a2 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:27.844720 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 492/1011] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:44:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:44:27.850628 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de6f6f-181a-4fd8-a4b9-7e6292052611 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:27.850986 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de6f6f-181a-4fd8-a4b9-7e6292052611 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:27.851186 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de6f6f-181a-4fd8-a4b9-7e6292052611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:27.872743 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-36de6f6f-181a-4fd8-a4b9-7e6292052611 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:44:27.875090 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-36de6f6f-181a-4fd8-a4b9-7e6292052611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:44:27.974794 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 520/1012] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:44:27 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 00:44:28.244634 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc31c3-f4c3-4ddc-9df8-1ffb1dec41a2 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:28.377763 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc31c3-f4c3-4ddc-9df8-1ffb1dec41a2 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:28.387916 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:28.432029 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e3df56-f518-495d-a08b-ef139e3aab8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:28.432698 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3df56-f518-495d-a08b-ef139e3aab8a None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:28.432976 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3df56-f518-495d-a08b-ef139e3aab8a None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:28.433293 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3df56-f518-495d-a08b-ef139e3aab8a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:28.434641 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e3df56-f518-495d-a08b-ef139e3aab8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:28.436225 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e3df56-f518-495d-a08b-ef139e3aab8a None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:28.438407 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 493/1013] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:44:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:28.445018 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36de6f6f-181a-4fd8-a4b9-7e6292052611 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:28.474294 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:28.595926 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36de6f6f-181a-4fd8-a4b9-7e6292052611 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:28.635094 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eede175-022f-404a-b71c-15d3d5445ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:28.635742 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eede175-022f-404a-b71c-15d3d5445ac2 None admin] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:28.636070 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eede175-022f-404a-b71c-15d3d5445ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:28.636340 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eede175-022f-404a-b71c-15d3d5445ac2 None admin] PATH_INFO: `/v3/projects` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:28.637078 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eede175-022f-404a-b71c-15d3d5445ac2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:28.638545 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eede175-022f-404a-b71c-15d3d5445ac2 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:28.671044 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 521/1014] 10.222.0.15 () {60 vars in 1141 bytes} [Sun Sep 18 00:44:28 2022] POST /identity/v3/projects => generated 311 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 00:44:29.293600 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a50e19-5d8e-40ab-bbe8-4b9a59294d98 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:29.294412 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a50e19-5d8e-40ab-bbe8-4b9a59294d98 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:29.294412 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a50e19-5d8e-40ab-bbe8-4b9a59294d98 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:29.295494 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 494/1015] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:44:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 18 00:44:29.305198 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb86b43-2b08-40d4-9b2b-8ec536f68769 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:29.305737 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb86b43-2b08-40d4-9b2b-8ec536f68769 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:29.306237 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb86b43-2b08-40d4-9b2b-8ec536f68769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:29.337679 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-1eb86b43-2b08-40d4-9b2b-8ec536f68769 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:44:29.339743 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-1eb86b43-2b08-40d4-9b2b-8ec536f68769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:44:29.459136 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:29.476407 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 522/1016] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:44:29 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 00:44:29.509171 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fddfbd-0730-4c23-89e3-24eee8d57137 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:29.509456 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fddfbd-0730-4c23-89e3-24eee8d57137 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:29.510002 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fddfbd-0730-4c23-89e3-24eee8d57137 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:29.511537 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 495/1017] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:44:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:44:29.518712 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde5653-798a-4f3a-bf72-d3599f8562d0 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:29.519007 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde5653-798a-4f3a-bf72-d3599f8562d0 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:29.519288 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde5653-798a-4f3a-bf72-d3599f8562d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:29.538448 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-1dde5653-798a-4f3a-bf72-d3599f8562d0 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:44:29.539665 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-1dde5653-798a-4f3a-bf72-d3599f8562d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:44:29.612931 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 523/1018] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:44:29 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 00:44:29.885427 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fddfbd-0730-4c23-89e3-24eee8d57137 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:29.952473 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde5653-798a-4f3a-bf72-d3599f8562d0 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:30.045545 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fddfbd-0730-4c23-89e3-24eee8d57137 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:30.091437 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb7b38-ab2f-426c-9e7a-711225c4cf68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:30.092398 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb7b38-ab2f-426c-9e7a-711225c4cf68 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:30.092824 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb7b38-ab2f-426c-9e7a-711225c4cf68 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:30.093306 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb7b38-ab2f-426c-9e7a-711225c4cf68 None admin] PATH_INFO: `/v3/services/image` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:30.094173 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eb7b38-ab2f-426c-9e7a-711225c4cf68 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:30.095919 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eb7b38-ab2f-426c-9e7a-711225c4cf68 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:30.107326 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-d1eb7b38-ab2f-426c-9e7a-711225c4cf68 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 18 00:44:30.107326 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:30.107326 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 18 00:44:30.107326 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 18 00:44:30.107326 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 18 00:44:30.107326 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 18 00:44:30.107326 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 18 00:44:30.107326 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 00:44:30.107326 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 18 00:44:30.107326 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:44:30.107326 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 18 00:44:30.107326 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:44:30.107326 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:30.107326 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:44:30.107326 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:44:30.107326 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:44:30.107326 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:44:30.109320 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:44:30.109320 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:44:30.109320 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:44:30.109320 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:44:30.109320 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:44:30.109320 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:44:30.109320 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 18 00:44:30.109320 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 18 00:44:30.109320 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 18 00:44:30.109320 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 18 00:44:30.109320 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:44:30.109320 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:44:30.109320 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:44:30.109320 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:44:30.109320 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:44:30.109320 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:44:30.110393 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:44:30.110393 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:44:30.110393 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:44:30.110393 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:44:30.110393 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:44:30.110393 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:44:30.110393 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:44:30.110393 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:44:30.110393 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:44:30.110393 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:44:30.110393 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 18 00:44:30.110393 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 00:44:30.110393 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 18 00:44:30.110393 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:44:30.111206 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde5653-798a-4f3a-bf72-d3599f8562d0 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:30.111284 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 496/1019] 10.222.0.15 () {56 vars in 1105 bytes} [Sun Sep 18 00:44:29 2022] GET /identity/v3/services/image => generated 86 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:44:30.118182 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb7b38-ab2f-426c-9e7a-711225c4cf68 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:30.152973 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:30.166189 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9453b8-b9ca-410c-b1c5-03d81f562d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:30.167163 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9453b8-b9ca-410c-b1c5-03d81f562d17 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:30.167598 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9453b8-b9ca-410c-b1c5-03d81f562d17 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:30.168056 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9453b8-b9ca-410c-b1c5-03d81f562d17 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:30.169047 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9453b8-b9ca-410c-b1c5-03d81f562d17 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:30.170759 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9453b8-b9ca-410c-b1c5-03d81f562d17 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:30.182671 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-fd9453b8-b9ca-410c-b1c5-03d81f562d17 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 18 00:44:30.182671 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:30.182671 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 18 00:44:30.182671 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 18 00:44:30.182671 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 18 00:44:30.182671 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 18 00:44:30.182671 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 18 00:44:30.182671 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 00:44:30.182671 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 18 00:44:30.182671 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:44:30.182671 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 18 00:44:30.182671 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:44:30.182671 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:30.182671 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:44:30.182671 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:44:30.182671 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:44:30.182671 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:44:30.184977 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:44:30.184977 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:44:30.184977 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:44:30.184977 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:44:30.184977 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:44:30.184977 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:44:30.184977 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 18 00:44:30.184977 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 18 00:44:30.184977 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 18 00:44:30.184977 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 18 00:44:30.184977 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:44:30.184977 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:44:30.184977 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:44:30.184977 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:44:30.184977 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:44:30.184977 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:44:30.187242 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:44:30.187242 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:44:30.187242 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:44:30.187242 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:44:30.187242 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:44:30.187242 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:44:30.187242 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:44:30.187242 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:44:30.187242 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:44:30.187242 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:44:30.187242 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 18 00:44:30.187242 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 00:44:30.187242 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 18 00:44:30.187242 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:44:30.193067 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 524/1020] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Sep 18 00:44:29 2022] GET /identity/v3/services/compute => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:44:30.194169 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9453b8-b9ca-410c-b1c5-03d81f562d17 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:30.200368 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:30.284505 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb7b38-ab2f-426c-9e7a-711225c4cf68 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:30.338813 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa68f3-4c06-4978-b815-839b77d0b913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:30.341088 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa68f3-4c06-4978-b815-839b77d0b913 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:30.341535 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa68f3-4c06-4978-b815-839b77d0b913 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:30.342007 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa68f3-4c06-4978-b815-839b77d0b913 None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:30.343028 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa68f3-4c06-4978-b815-839b77d0b913 None admin] RBAC: Adding query filter params (name=image) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:30.343533 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa68f3-4c06-4978-b815-839b77d0b913 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:30.345917 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa68f3-4c06-4978-b815-839b77d0b913 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:30.362715 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 497/1021] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:44:30 2022] GET /identity/v3/services?name=image => generated 122 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:44:30.362996 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9453b8-b9ca-410c-b1c5-03d81f562d17 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:30.364400 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa68f3-4c06-4978-b815-839b77d0b913 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:30.404840 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef76a92-2b1d-4c61-89c5-363b0f361bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:30.404840 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef76a92-2b1d-4c61-89c5-363b0f361bff None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:30.404840 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef76a92-2b1d-4c61-89c5-363b0f361bff None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:30.404840 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef76a92-2b1d-4c61-89c5-363b0f361bff None admin] PATH_INFO: `/v3/services` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:30.408992 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef76a92-2b1d-4c61-89c5-363b0f361bff None admin] RBAC: Adding query filter params (name=compute) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:30.408992 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef76a92-2b1d-4c61-89c5-363b0f361bff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:30.408992 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef76a92-2b1d-4c61-89c5-363b0f361bff None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:30.414425 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 525/1022] 10.222.0.15 () {56 vars in 1112 bytes} [Sun Sep 18 00:44:30 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:30.420686 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef76a92-2b1d-4c61-89c5-363b0f361bff None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:30.496295 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:30.551563 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa68f3-4c06-4978-b815-839b77d0b913 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:30.553917 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:30.572966 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef76a92-2b1d-4c61-89c5-363b0f361bff None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:30.603044 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b26ad-6071-4a3b-accf-f2c6f3c5c103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:30.604254 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b26ad-6071-4a3b-accf-f2c6f3c5c103 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:30.604660 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b26ad-6071-4a3b-accf-f2c6f3c5c103 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:30.604940 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b26ad-6071-4a3b-accf-f2c6f3c5c103 None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:30.605584 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404b26ad-6071-4a3b-accf-f2c6f3c5c103 None admin] RBAC: Adding query filter params (type=image) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:30.605891 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404b26ad-6071-4a3b-accf-f2c6f3c5c103 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:30.607289 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404b26ad-6071-4a3b-accf-f2c6f3c5c103 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:30.615211 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 498/1023] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:44:30 2022] GET /identity/v3/services?type=image => generated 350 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:44:30.623621 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b26ad-6071-4a3b-accf-f2c6f3c5c103 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:30.627163 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135e9b0e-4c3b-461c-b59a-c326d80e1e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:30.627795 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e9b0e-4c3b-461c-b59a-c326d80e1e56 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:30.628118 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e9b0e-4c3b-461c-b59a-c326d80e1e56 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:30.628394 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e9b0e-4c3b-461c-b59a-c326d80e1e56 None admin] PATH_INFO: `/v3/services` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:30.629038 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135e9b0e-4c3b-461c-b59a-c326d80e1e56 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:30.629340 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135e9b0e-4c3b-461c-b59a-c326d80e1e56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:30.630732 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135e9b0e-4c3b-461c-b59a-c326d80e1e56 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:30.636774 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 526/1024] 10.222.0.15 () {56 vars in 1112 bytes} [Sun Sep 18 00:44:30 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:44:30.642947 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135e9b0e-4c3b-461c-b59a-c326d80e1e56 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:30.780879 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b26ad-6071-4a3b-accf-f2c6f3c5c103 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:30.794242 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135e9b0e-4c3b-461c-b59a-c326d80e1e56 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:30.832836 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:30.848877 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91aafb-b2c2-4d3a-8eba-52dd3cf3ddad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:30.849900 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91aafb-b2c2-4d3a-8eba-52dd3cf3ddad None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:30.850368 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb904162-bde2-40a8-8dea-cae0a945d381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:30.850552 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91aafb-b2c2-4d3a-8eba-52dd3cf3ddad None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:30.850948 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91aafb-b2c2-4d3a-8eba-52dd3cf3ddad None admin] PATH_INFO: `/v3/endpoints` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:30.851340 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb904162-bde2-40a8-8dea-cae0a945d381 None admin] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:30.851752 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb904162-bde2-40a8-8dea-cae0a945d381 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:30.852210 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb904162-bde2-40a8-8dea-cae0a945d381 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:30.852369 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f91aafb-b2c2-4d3a-8eba-52dd3cf3ddad None admin] RBAC: Adding query filter params (interface=public, service_id=210fd865621847af991acdfcb55d3d48, region_id=RegionOne) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:30.852830 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f91aafb-b2c2-4d3a-8eba-52dd3cf3ddad None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:30.853225 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb904162-bde2-40a8-8dea-cae0a945d381 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:30.854751 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb904162-bde2-40a8-8dea-cae0a945d381 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:30.855306 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f91aafb-b2c2-4d3a-8eba-52dd3cf3ddad None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:30.866886 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 499/1025] 10.222.0.15 () {56 vars in 1251 bytes} [Sun Sep 18 00:44:30 2022] GET /identity/v3/endpoints?service_id=210fd865621847af991acdfcb55d3d48&interface=public®ion_id=RegionOne => generated 194 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:44:30.873215 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91aafb-b2c2-4d3a-8eba-52dd3cf3ddad None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:30.882589 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 527/1026] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Sep 18 00:44:30 2022] POST /identity/v3/endpoints => generated 334 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 00:44:30.926785 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:30.949814 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408ee5d-eaca-458f-8f78-0a5429cbe6a1 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:30.950194 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408ee5d-eaca-458f-8f78-0a5429cbe6a1 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:30.950380 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408ee5d-eaca-458f-8f78-0a5429cbe6a1 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:30.951831 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 528/1027] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:44:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 18 00:44:30.957960 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d1b44-db3e-468e-8240-e0c97348341a None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:30.958218 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d1b44-db3e-468e-8240-e0c97348341a None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:30.958509 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d1b44-db3e-468e-8240-e0c97348341a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:30.978432 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-467d1b44-db3e-468e-8240-e0c97348341a None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:44:30.979677 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-467d1b44-db3e-468e-8240-e0c97348341a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:44:31.057354 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91aafb-b2c2-4d3a-8eba-52dd3cf3ddad None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:31.081200 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 529/1028] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:44:30 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 18 00:44:31.112859 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42402da5-6639-4d6a-af5f-f90229a7af9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:31.113934 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42402da5-6639-4d6a-af5f-f90229a7af9e None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:31.114451 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42402da5-6639-4d6a-af5f-f90229a7af9e None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:31.115507 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42402da5-6639-4d6a-af5f-f90229a7af9e None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:31.116029 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42402da5-6639-4d6a-af5f-f90229a7af9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:31.118682 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42402da5-6639-4d6a-af5f-f90229a7af9e None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:31.127967 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 500/1029] 10.222.0.15 () {56 vars in 1087 bytes} [Sun Sep 18 00:44:30 2022] GET /identity/v3/services => generated 1957 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 18 00:44:31.362347 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d1b44-db3e-468e-8240-e0c97348341a None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:31.518811 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d1b44-db3e-468e-8240-e0c97348341a None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:31.523270 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:31.567504 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d3df4-baec-4f97-a596-7aeae3f90869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:31.568179 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d3df4-baec-4f97-a596-7aeae3f90869 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:31.568517 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d3df4-baec-4f97-a596-7aeae3f90869 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:31.568785 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d3df4-baec-4f97-a596-7aeae3f90869 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:31.569865 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498d3df4-baec-4f97-a596-7aeae3f90869 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:31.571307 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498d3df4-baec-4f97-a596-7aeae3f90869 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:31.573225 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 530/1030] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:44:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:31.579572 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42402da5-6639-4d6a-af5f-f90229a7af9e None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:31.702240 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:31.714395 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42402da5-6639-4d6a-af5f-f90229a7af9e None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:31.771384 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfa852a-a26b-4a87-9849-d25c38eb30ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:31.772445 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa852a-a26b-4a87-9849-d25c38eb30ec None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:31.772988 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa852a-a26b-4a87-9849-d25c38eb30ec None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:31.773499 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa852a-a26b-4a87-9849-d25c38eb30ec None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:31.774540 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfa852a-a26b-4a87-9849-d25c38eb30ec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:31.777359 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfa852a-a26b-4a87-9849-d25c38eb30ec None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:31.807956 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 501/1031] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Sep 18 00:44:31 2022] POST /identity/v3/users => generated 285 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 00:44:34.114460 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d03d3-6274-494d-b66c-639f05e9960b None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:34.115275 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d03d3-6274-494d-b66c-639f05e9960b None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:34.115402 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d03d3-6274-494d-b66c-639f05e9960b None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:34.118088 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 531/1032] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:44:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:44:34.126428 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ab6a9-110e-460a-8966-5e3567c6c1f0 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:34.126956 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ab6a9-110e-460a-8966-5e3567c6c1f0 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:34.127034 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ab6a9-110e-460a-8966-5e3567c6c1f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:34.146993 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-7f8ab6a9-110e-460a-8966-5e3567c6c1f0 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:44:34.148260 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-7f8ab6a9-110e-460a-8966-5e3567c6c1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:44:34.240107 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 502/1033] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:44:34 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 00:44:34.266723 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958407e6-0b1e-4a27-a8bc-a3bdd87bf345 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:34.267066 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958407e6-0b1e-4a27-a8bc-a3bdd87bf345 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:34.267349 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958407e6-0b1e-4a27-a8bc-a3bdd87bf345 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:34.269024 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 532/1034] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:44:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:44:34.278716 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9409f-2b50-47b4-bdae-9b6e3c77a0fa None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:34.279189 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9409f-2b50-47b4-bdae-9b6e3c77a0fa None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:34.279681 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9409f-2b50-47b4-bdae-9b6e3c77a0fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:34.313202 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-68c9409f-2b50-47b4-bdae-9b6e3c77a0fa None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:44:34.315336 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-68c9409f-2b50-47b4-bdae-9b6e3c77a0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:44:34.352150 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a8dab-f5dc-4f52-bd26-3856279704a8 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:34.352609 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a8dab-f5dc-4f52-bd26-3856279704a8 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:34.353060 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a8dab-f5dc-4f52-bd26-3856279704a8 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:34.355519 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 533/1035] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:44:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:44:34.361639 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc95ab2-ba06-4f7b-add9-a5e60e2c345b None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:34.362090 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc95ab2-ba06-4f7b-add9-a5e60e2c345b None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:34.362569 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc95ab2-ba06-4f7b-add9-a5e60e2c345b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:34.384041 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-9bc95ab2-ba06-4f7b-add9-a5e60e2c345b None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:44:34.385382 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-9bc95ab2-ba06-4f7b-add9-a5e60e2c345b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:44:34.428033 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 503/1036] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:44:34 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 00:44:34.475493 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 534/1037] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:44:34 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 18 00:44:34.517960 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c9409f-2b50-47b4-bdae-9b6e3c77a0fa None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:34.531064 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:34.683978 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c9409f-2b50-47b4-bdae-9b6e3c77a0fa None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:34.711927 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc95ab2-ba06-4f7b-add9-a5e60e2c345b None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:34.733769 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4fd099-1c6b-4c9a-83c6-9b6c1b373f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:34.734447 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4fd099-1c6b-4c9a-83c6-9b6c1b373f26 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:34.734737 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4fd099-1c6b-4c9a-83c6-9b6c1b373f26 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:34.735016 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4fd099-1c6b-4c9a-83c6-9b6c1b373f26 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:34.746430 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4fd099-1c6b-4c9a-83c6-9b6c1b373f26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:44:34.752077 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-ac4fd099-1c6b-4c9a-83c6-9b6c1b373f26 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 00:44:34.752077 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:34.752077 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:44:34.752077 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:44:34.752077 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:44:34.752077 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:44:34.752077 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:44:34.752077 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:44:34.752077 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:44:34.752077 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:44:34.752077 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:44:34.752077 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:44:34.752077 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:44:34.752077 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:44:34.752077 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:44:34.752077 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:44:34.752998 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:44:34.752998 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:44:34.752998 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:44:34.752998 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:44:34.752998 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:44:34.752998 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:44:34.752998 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:44:34.752998 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:44:34.752998 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:44:34.752998 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:44:34.752998 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:44:34.752998 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:44:34.752998 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:44:34.752998 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:44:34.752998 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:44:34.752998 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:44:34.754419 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:44:34.754419 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:44:34.754419 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:44:34.754419 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:44:34.754419 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:44:34.754419 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:44:34.754419 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:44:34.754419 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:44:34.754419 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:44:34.754419 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:44:34.754419 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 00:44:34.754419 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:44:34.754419 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 504/1038] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Sep 18 00:44:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 00:44:34.754419 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4fd099-1c6b-4c9a-83c6-9b6c1b373f26 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:34.839910 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:34.840379 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc95ab2-ba06-4f7b-add9-a5e60e2c345b None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:34.843060 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:34.878757 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4fd099-1c6b-4c9a-83c6-9b6c1b373f26 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:34.882970 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451aefc5-a8ce-496e-989b-a670a5f77e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:34.883612 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451aefc5-a8ce-496e-989b-a670a5f77e09 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:34.883905 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451aefc5-a8ce-496e-989b-a670a5f77e09 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:34.884186 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451aefc5-a8ce-496e-989b-a670a5f77e09 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:34.895566 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451aefc5-a8ce-496e-989b-a670a5f77e09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:44:34.900419 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-451aefc5-a8ce-496e-989b-a670a5f77e09 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 18 00:44:34.900419 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:34.900419 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:44:34.900419 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:44:34.900419 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:44:34.900419 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:44:34.900419 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:44:34.900419 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:44:34.900419 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:44:34.900419 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:44:34.900419 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:44:34.900419 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:44:34.900419 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:44:34.900419 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:44:34.900419 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:44:34.900419 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:44:34.904788 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:44:34.904788 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:44:34.904788 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:44:34.904788 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:44:34.904788 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:44:34.904788 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:44:34.904788 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:44:34.904788 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:44:34.904788 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:44:34.904788 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:44:34.904788 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:44:34.904788 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:44:34.904788 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:44:34.904788 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:44:34.904788 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:44:34.904788 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:44:34.907065 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:44:34.907065 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:44:34.907065 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:44:34.907065 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:44:34.907065 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:44:34.907065 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:44:34.907065 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:44:34.907065 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:44:34.907065 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:44:34.907065 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:44:34.907065 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 18 00:44:34.907065 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:44:34.907065 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 535/1039] 10.222.0.15 () {56 vars in 1120 bytes} [Sun Sep 18 00:44:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:44:34.907065 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451aefc5-a8ce-496e-989b-a670a5f77e09 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:34.919126 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed2bc00-56b8-4c3a-873e-4d478826b508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:34.919773 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2bc00-56b8-4c3a-873e-4d478826b508 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:34.920077 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2bc00-56b8-4c3a-873e-4d478826b508 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:34.920351 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2bc00-56b8-4c3a-873e-4d478826b508 None admin] PATH_INFO: `/v3/services/image` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:34.921458 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed2bc00-56b8-4c3a-873e-4d478826b508 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:34.922847 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed2bc00-56b8-4c3a-873e-4d478826b508 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:34.931874 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-1ed2bc00-56b8-4c3a-873e-4d478826b508 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 18 00:44:34.931874 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:34.931874 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 18 00:44:34.931874 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 18 00:44:34.931874 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 18 00:44:34.931874 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 18 00:44:34.931874 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 18 00:44:34.931874 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 00:44:34.931874 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 18 00:44:34.931874 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:44:34.931874 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 18 00:44:34.931874 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:44:34.931874 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:34.931874 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:44:34.931874 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:44:34.931874 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:44:34.931874 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:44:34.933247 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:44:34.933247 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:44:34.933247 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:44:34.933247 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:44:34.933247 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:44:34.933247 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:44:34.933247 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 18 00:44:34.933247 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 18 00:44:34.933247 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 18 00:44:34.933247 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 18 00:44:34.933247 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:44:34.933247 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:44:34.933247 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:44:34.933247 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:44:34.933247 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:44:34.933247 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:44:34.934240 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:44:34.934240 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:44:34.934240 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:44:34.934240 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:44:34.934240 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:44:34.934240 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:44:34.934240 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:44:34.934240 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:44:34.934240 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:44:34.934240 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:44:34.934240 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 18 00:44:34.934240 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 00:44:34.934240 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 18 00:44:34.934240 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:44:34.934240 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 505/1040] 10.222.0.15 () {56 vars in 1105 bytes} [Sun Sep 18 00:44:34 2022] GET /identity/v3/services/image => generated 86 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:44:34.935078 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed2bc00-56b8-4c3a-873e-4d478826b508 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:35.027251 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451aefc5-a8ce-496e-989b-a670a5f77e09 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:35.054453 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed2bc00-56b8-4c3a-873e-4d478826b508 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:35.079411 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd528c-c91d-45ce-ba0b-12c626d26b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:35.080497 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd528c-c91d-45ce-ba0b-12c626d26b0f None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:35.081006 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd528c-c91d-45ce-ba0b-12c626d26b0f None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:35.081513 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd528c-c91d-45ce-ba0b-12c626d26b0f None admin] PATH_INFO: `/v3/roles` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:35.082635 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dd528c-c91d-45ce-ba0b-12c626d26b0f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:35.083186 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dd528c-c91d-45ce-ba0b-12c626d26b0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:35.085825 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dd528c-c91d-45ce-ba0b-12c626d26b0f None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:35.089586 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a7a7a4-f4a4-4caa-86ac-b147313ecb2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:35.090203 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7a7a4-f4a4-4caa-86ac-b147313ecb2e None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:35.090481 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7a7a4-f4a4-4caa-86ac-b147313ecb2e None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:35.090753 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7a7a4-f4a4-4caa-86ac-b147313ecb2e None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:35.091410 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a7a7a4-f4a4-4caa-86ac-b147313ecb2e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:35.091711 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a7a7a4-f4a4-4caa-86ac-b147313ecb2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:35.093721 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a7a7a4-f4a4-4caa-86ac-b147313ecb2e None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:35.095210 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:35.101904 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 536/1041] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Sep 18 00:44:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:35.103307 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd528c-c91d-45ce-ba0b-12c626d26b0f None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:35.103830 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 506/1042] 10.222.0.15 () {56 vars in 1115 bytes} [Sun Sep 18 00:44:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:35.109355 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a7a7a4-f4a4-4caa-86ac-b147313ecb2e None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:35.140785 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:35.215382 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a7a7a4-f4a4-4caa-86ac-b147313ecb2e None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:35.239337 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd528c-c91d-45ce-ba0b-12c626d26b0f None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:35.269036 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd73631-5319-4cfb-97fa-38c3dd17fa7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:35.269726 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd73631-5319-4cfb-97fa-38c3dd17fa7c None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:35.270206 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd73631-5319-4cfb-97fa-38c3dd17fa7c None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:35.271016 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd73631-5319-4cfb-97fa-38c3dd17fa7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:35.288926 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd73631-5319-4cfb-97fa-38c3dd17fa7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:35.291059 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd73631-5319-4cfb-97fa-38c3dd17fa7c None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:35.303679 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a590a77-b146-463a-b9ab-85455909fbb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:35.304801 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a590a77-b146-463a-b9ab-85455909fbb7 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:35.305338 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a590a77-b146-463a-b9ab-85455909fbb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:35.305824 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a590a77-b146-463a-b9ab-85455909fbb7 None admin] PATH_INFO: `/v3/services` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:35.307007 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a590a77-b146-463a-b9ab-85455909fbb7 None admin] RBAC: Adding query filter params (name=image) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:35.307166 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-4bd73631-5319-4cfb-97fa-38c3dd17fa7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:44:35.307166 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:35.307166 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:44:35.307166 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:44:35.307166 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:44:35.307166 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:44:35.307166 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:44:35.307166 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:44:35.307166 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:44:35.307166 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:44:35.307166 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:44:35.307166 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:44:35.307166 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:44:35.307166 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:44:35.307166 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:44:35.307166 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:44:35.308118 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:44:35.308118 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:44:35.308118 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:44:35.308118 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:44:35.308118 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:44:35.308118 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:44:35.308118 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:44:35.308118 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:44:35.308118 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:44:35.308118 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:44:35.308118 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:44:35.308118 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:44:35.308118 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:44:35.308118 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:44:35.308118 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:44:35.308118 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:44:35.308118 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:44:35.314537 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:44:35.314537 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:44:35.314537 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:44:35.314768 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a590a77-b146-463a-b9ab-85455909fbb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:35.314863 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 507/1043] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:44:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 00:44:35.314863 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd73631-5319-4cfb-97fa-38c3dd17fa7c None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:35.315023 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a590a77-b146-463a-b9ab-85455909fbb7 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:35.319731 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 537/1044] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:44:35 2022] GET /identity/v3/services?name=image => generated 122 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:35.320744 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a590a77-b146-463a-b9ab-85455909fbb7 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:35.388045 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:35.442568 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:35.454771 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd73631-5319-4cfb-97fa-38c3dd17fa7c None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:35.456276 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a590a77-b146-463a-b9ab-85455909fbb7 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:35.494107 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e0439-f590-4c47-8eef-2be5d4f39b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:35.494770 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e0439-f590-4c47-8eef-2be5d4f39b7c None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:35.495052 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e0439-f590-4c47-8eef-2be5d4f39b7c None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:35.495331 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e0439-f590-4c47-8eef-2be5d4f39b7c None admin] PATH_INFO: `/v3/users/878c3f94dfd240e698abe85f49694158` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:35.499363 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac286f6a-15b1-4f5f-83cf-104b4915417f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:35.500065 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac286f6a-15b1-4f5f-83cf-104b4915417f None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:35.500347 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac286f6a-15b1-4f5f-83cf-104b4915417f None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:35.500613 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac286f6a-15b1-4f5f-83cf-104b4915417f None admin] PATH_INFO: `/v3/domains` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:35.501263 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac286f6a-15b1-4f5f-83cf-104b4915417f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:35.501561 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac286f6a-15b1-4f5f-83cf-104b4915417f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:35.502934 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac286f6a-15b1-4f5f-83cf-104b4915417f None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:35.515844 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 538/1045] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:44:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:35.516803 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac286f6a-15b1-4f5f-83cf-104b4915417f None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:35.518242 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1e0439-f590-4c47-8eef-2be5d4f39b7c None admin] RBAC: Authorizing `identity:get_user(user_id=878c3f94dfd240e698abe85f49694158)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:35.520311 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1e0439-f590-4c47-8eef-2be5d4f39b7c None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:35.522174 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 508/1046] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Sep 18 00:44:35 2022] GET /identity/v3/users/878c3f94dfd240e698abe85f49694158 => generated 285 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:35.523362 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e0439-f590-4c47-8eef-2be5d4f39b7c None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:35.628427 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac286f6a-15b1-4f5f-83cf-104b4915417f None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:35.663160 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e0439-f590-4c47-8eef-2be5d4f39b7c None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:35.666521 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d338e9-b230-403f-8784-6af36f2642f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:35.667152 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d338e9-b230-403f-8784-6af36f2642f6 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:35.667428 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d338e9-b230-403f-8784-6af36f2642f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:35.667701 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d338e9-b230-403f-8784-6af36f2642f6 None admin] PATH_INFO: `/v3/services` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:35.668374 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d338e9-b230-403f-8784-6af36f2642f6 None admin] RBAC: Adding query filter params (type=image) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:35.668679 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d338e9-b230-403f-8784-6af36f2642f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:35.670062 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d338e9-b230-403f-8784-6af36f2642f6 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:35.676119 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 539/1047] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:44:35 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:35.676986 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d338e9-b230-403f-8784-6af36f2642f6 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:35.683760 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:35.695872 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:35.716986 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e8ba91-3ea3-404d-91ea-c01d0bb2727a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:35.718154 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e8ba91-3ea3-404d-91ea-c01d0bb2727a None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:35.718674 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e8ba91-3ea3-404d-91ea-c01d0bb2727a None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:35.719176 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e8ba91-3ea3-404d-91ea-c01d0bb2727a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:35.732505 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e8ba91-3ea3-404d-91ea-c01d0bb2727a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:35.735661 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e8ba91-3ea3-404d-91ea-c01d0bb2727a None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:35.758083 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-e0e8ba91-3ea3-404d-91ea-c01d0bb2727a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 18 00:44:35.758083 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:35.758083 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:44:35.758083 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:44:35.758083 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:44:35.758083 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:44:35.758083 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:44:35.758083 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:44:35.758083 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:44:35.758083 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:44:35.758083 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:44:35.758083 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:44:35.758083 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 00:44:35.758083 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 00:44:35.758083 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 00:44:35.758083 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 00:44:35.759121 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:44:35.759121 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:44:35.759121 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 00:44:35.759121 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:44:35.759121 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 00:44:35.759121 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:44:35.759121 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:44:35.759121 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:44:35.759121 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:44:35.759121 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:44:35.759121 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:44:35.759121 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:44:35.759121 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:44:35.759121 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:44:35.759121 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:44:35.759121 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:44:35.759121 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:44:35.759121 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:44:35.760430 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:44:35.760430 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:44:35.760430 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 00:44:35.760430 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 00:44:35.760430 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 00:44:35.760430 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 00:44:35.760430 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 00:44:35.760430 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 00:44:35.760430 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 18 00:44:35.760430 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:44:35.760430 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 509/1048] 10.222.0.15 () {56 vars in 1093 bytes} [Sun Sep 18 00:44:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:44:35.761512 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e8ba91-3ea3-404d-91ea-c01d0bb2727a None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:35.825526 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d338e9-b230-403f-8784-6af36f2642f6 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:35.867370 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b7bb5a-7f0e-4a28-9764-7adf499a6f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:35.868045 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7bb5a-7f0e-4a28-9764-7adf499a6f2b None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:35.868325 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7bb5a-7f0e-4a28-9764-7adf499a6f2b None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:35.868595 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7bb5a-7f0e-4a28-9764-7adf499a6f2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:35.905866 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e8ba91-3ea3-404d-91ea-c01d0bb2727a None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:35.956525 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b7bb5a-7f0e-4a28-9764-7adf499a6f2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:35.958013 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b7bb5a-7f0e-4a28-9764-7adf499a6f2b None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:35.959034 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826b6ed-e8c4-4e6e-b305-ed87a11f0010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:35.959686 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826b6ed-e8c4-4e6e-b305-ed87a11f0010 None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:35.959993 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826b6ed-e8c4-4e6e-b305-ed87a11f0010 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:35.960271 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826b6ed-e8c4-4e6e-b305-ed87a11f0010 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:35.960954 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f826b6ed-e8c4-4e6e-b305-ed87a11f0010 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:35.962368 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f826b6ed-e8c4-4e6e-b305-ed87a11f0010 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:35.974543 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:35.985137 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 510/1049] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Sep 18 00:44:35 2022] POST /identity/v3/endpoints => generated 327 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 00:44:35.985930 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826b6ed-e8c4-4e6e-b305-ed87a11f0010 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:36.026404 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:36.093424 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 540/1050] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Sep 18 00:44:35 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 18 00:44:36.099445 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b7bb5a-7f0e-4a28-9764-7adf499a6f2b None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:36.158314 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826b6ed-e8c4-4e6e-b305-ed87a11f0010 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:36.221520 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbeaee1-2604-493f-9d92-7db7d491c861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:36.222561 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbeaee1-2604-493f-9d92-7db7d491c861 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:36.223445 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbeaee1-2604-493f-9d92-7db7d491c861 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:36.223445 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbeaee1-2604-493f-9d92-7db7d491c861 None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:36.223749 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbeaee1-2604-493f-9d92-7db7d491c861 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:36.224211 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbeaee1-2604-493f-9d92-7db7d491c861 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:36.226255 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbeaee1-2604-493f-9d92-7db7d491c861 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:36.253796 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 511/1051] 10.222.0.15 () {56 vars in 1133 bytes} [Sun Sep 18 00:44:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:36.257716 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b7bb5a-7f0e-4a28-9764-7adf499a6f2b None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:36.260401 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbeaee1-2604-493f-9d92-7db7d491c861 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:36.278721 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:36.309533 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeedec7-a284-4257-9f93-b40cbc3d8682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:36.310600 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeedec7-a284-4257-9f93-b40cbc3d8682 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:36.311150 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeedec7-a284-4257-9f93-b40cbc3d8682 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:36.312568 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeedec7-a284-4257-9f93-b40cbc3d8682 None admin] PATH_INFO: `/v3/projects/950f1f754e7b45f8981f323d44fc0803` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:36.314481 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeedec7-a284-4257-9f93-b40cbc3d8682 None admin] RBAC: Authorizing `identity:get_project(project_id=950f1f754e7b45f8981f323d44fc0803)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:36.317034 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeedec7-a284-4257-9f93-b40cbc3d8682 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:36.323951 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 541/1052] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Sep 18 00:44:36 2022] GET /identity/v3/projects/950f1f754e7b45f8981f323d44fc0803 => generated 311 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:44:36.328710 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeedec7-a284-4257-9f93-b40cbc3d8682 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:36.376570 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:36.416605 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbeaee1-2604-493f-9d92-7db7d491c861 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:36.484716 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6146a5ec-341c-4bd7-8872-641144f96bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:36.485726 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146a5ec-341c-4bd7-8872-641144f96bd0 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:36.486661 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146a5ec-341c-4bd7-8872-641144f96bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:36.486661 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146a5ec-341c-4bd7-8872-641144f96bd0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:36.493804 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeedec7-a284-4257-9f93-b40cbc3d8682 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:36.534756 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc54cd-cea9-4331-a35d-1364c162dd38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:36.535296 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc54cd-cea9-4331-a35d-1364c162dd38 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:36.535585 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc54cd-cea9-4331-a35d-1364c162dd38 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:36.535849 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc54cd-cea9-4331-a35d-1364c162dd38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:36.536596 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadc54cd-cea9-4331-a35d-1364c162dd38 None admin] RBAC: Adding query filter params (role.id=591d4711dc204cf98003c8b7d7558506, scope.project.id=950f1f754e7b45f8981f323d44fc0803, user.id=878c3f94dfd240e698abe85f49694158) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:36.536913 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadc54cd-cea9-4331-a35d-1364c162dd38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:36.538336 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadc54cd-cea9-4331-a35d-1364c162dd38 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:36.548650 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 542/1053] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Sep 18 00:44:36 2022] GET /identity/v3/role_assignments?user.id=878c3f94dfd240e698abe85f49694158&scope.project.id=950f1f754e7b45f8981f323d44fc0803&role.id=591d4711dc204cf98003c8b7d7558506 => generated 259 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:44:36.620902 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6146a5ec-341c-4bd7-8872-641144f96bd0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:36.623756 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6146a5ec-341c-4bd7-8872-641144f96bd0 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:36.771369 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:36.824055 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 512/1054] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Sep 18 00:44:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 18 00:44:36.826729 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc54cd-cea9-4331-a35d-1364c162dd38 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:36.905424 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:36.975575 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc54cd-cea9-4331-a35d-1364c162dd38 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:37.022464 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f2c70-d7ac-456e-9f1f-5ddf9a76103c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:37.023215 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f2c70-d7ac-456e-9f1f-5ddf9a76103c None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:37.023533 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f2c70-d7ac-456e-9f1f-5ddf9a76103c None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:37.023813 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f2c70-d7ac-456e-9f1f-5ddf9a76103c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:37.039194 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601f2c70-d7ac-456e-9f1f-5ddf9a76103c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:37.041147 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601f2c70-d7ac-456e-9f1f-5ddf9a76103c None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:37.058999 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-601f2c70-d7ac-456e-9f1f-5ddf9a76103c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:44:37.058999 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:37.058999 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:44:37.058999 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:44:37.058999 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:44:37.058999 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:44:37.058999 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:44:37.058999 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:44:37.058999 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:44:37.058999 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:44:37.058999 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:44:37.058999 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:44:37.058999 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:44:37.058999 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:44:37.058999 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:44:37.058999 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:44:37.060899 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:44:37.060899 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:44:37.060899 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:44:37.060899 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:44:37.060899 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:44:37.060899 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:44:37.060899 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:44:37.060899 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:44:37.060899 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:44:37.060899 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:44:37.060899 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:44:37.060899 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:44:37.060899 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:44:37.060899 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:44:37.060899 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:44:37.060899 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:44:37.060899 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:44:37.064339 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:44:37.064339 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:44:37.064339 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:44:37.067927 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 543/1055] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:44:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:44:37.068830 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6146a5ec-341c-4bd7-8872-641144f96bd0 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:37.248880 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6146a5ec-341c-4bd7-8872-641144f96bd0 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:37.310927 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc06c8-2e0a-449d-8721-1103e89a878f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:37.312557 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc06c8-2e0a-449d-8721-1103e89a878f None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:37.312968 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc06c8-2e0a-449d-8721-1103e89a878f None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:37.313459 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc06c8-2e0a-449d-8721-1103e89a878f None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:37.314627 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbc06c8-2e0a-449d-8721-1103e89a878f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:37.314955 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbc06c8-2e0a-449d-8721-1103e89a878f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:37.317634 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbc06c8-2e0a-449d-8721-1103e89a878f None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:37.337998 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 513/1056] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:44:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:37.347957 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f2c70-d7ac-456e-9f1f-5ddf9a76103c None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:37.526561 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:37.538831 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f2c70-d7ac-456e-9f1f-5ddf9a76103c None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:37.606647 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8ac6e-1d37-4a62-b2ac-9993187a24e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:37.607410 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8ac6e-1d37-4a62-b2ac-9993187a24e1 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:37.607722 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8ac6e-1d37-4a62-b2ac-9993187a24e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:37.608035 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8ac6e-1d37-4a62-b2ac-9993187a24e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:37.618567 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f8ac6e-1d37-4a62-b2ac-9993187a24e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:37.621329 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f8ac6e-1d37-4a62-b2ac-9993187a24e1 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:37.637105 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-d8f8ac6e-1d37-4a62-b2ac-9993187a24e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:44:37.637105 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:37.637105 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:44:37.637105 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:44:37.637105 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:44:37.637105 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:44:37.637105 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:44:37.637105 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:44:37.637105 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:44:37.637105 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:44:37.637105 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:44:37.637105 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:44:37.637105 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 00:44:37.637105 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 00:44:37.637105 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 00:44:37.645100 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 00:44:37.645100 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:44:37.645100 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:44:37.645100 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:44:37.645100 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:44:37.645100 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:44:37.645100 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:44:37.645100 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:44:37.645100 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:44:37.645100 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:44:37.645100 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:44:37.645100 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:44:37.645100 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:44:37.645100 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:44:37.645100 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:44:37.645100 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:44:37.645100 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:44:37.647205 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 00:44:37.647205 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 00:44:37.647205 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 00:44:37.647205 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 00:44:37.647205 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 00:44:37.647205 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 00:44:37.647205 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:44:37.647205 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:44:37.647205 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 544/1057] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Sep 18 00:44:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:44:37.652661 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc06c8-2e0a-449d-8721-1103e89a878f None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:37.713977 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:37.805524 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc06c8-2e0a-449d-8721-1103e89a878f None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:37.850179 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02192452-037b-418c-903b-715edc6a762a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:37.851175 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02192452-037b-418c-903b-715edc6a762a None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:37.851657 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02192452-037b-418c-903b-715edc6a762a None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:37.852193 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02192452-037b-418c-903b-715edc6a762a None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:37.853510 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02192452-037b-418c-903b-715edc6a762a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:37.854037 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02192452-037b-418c-903b-715edc6a762a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:37.856035 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02192452-037b-418c-903b-715edc6a762a None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:37.875620 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 514/1058] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Sep 18 00:44:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:37.885349 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8ac6e-1d37-4a62-b2ac-9993187a24e1 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:38.072938 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8ac6e-1d37-4a62-b2ac-9993187a24e1 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:38.125621 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df67b6-3b10-4db9-870f-d2e2d63e752b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:38.126265 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df67b6-3b10-4db9-870f-d2e2d63e752b None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:38.126543 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df67b6-3b10-4db9-870f-d2e2d63e752b None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:38.126833 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df67b6-3b10-4db9-870f-d2e2d63e752b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:38.127590 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5df67b6-3b10-4db9-870f-d2e2d63e752b None admin] RBAC: Adding query filter params (role.id=5e489759b2bc48d6b3895ed9d1f79f19, scope.project.id=52ebde8fa3f84ede9ef575f7c0780798, user.id=264c183fff8a49478eea4aceea73273e) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:38.127923 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5df67b6-3b10-4db9-870f-d2e2d63e752b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:38.129465 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5df67b6-3b10-4db9-870f-d2e2d63e752b None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:38.136537 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 545/1059] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Sep 18 00:44:37 2022] GET /identity/v3/role_assignments?user.id=264c183fff8a49478eea4aceea73273e&scope.project.id=52ebde8fa3f84ede9ef575f7c0780798&role.id=5e489759b2bc48d6b3895ed9d1f79f19 => generated 259 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:38.352570 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13dfab6-a062-4260-88cb-3299985b05df None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:38.353060 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13dfab6-a062-4260-88cb-3299985b05df None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:38.353060 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13dfab6-a062-4260-88cb-3299985b05df None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:38.354665 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 515/1060] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:44:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:44:38.360459 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb6f48-9d66-497c-85ea-ffd05dee15fb None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:38.361014 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb6f48-9d66-497c-85ea-ffd05dee15fb None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:38.361014 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb6f48-9d66-497c-85ea-ffd05dee15fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:38.381413 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-50fb6f48-9d66-497c-85ea-ffd05dee15fb None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:44:38.382632 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-50fb6f48-9d66-497c-85ea-ffd05dee15fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:44:38.399866 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:38.467959 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 546/1061] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:44:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 00:44:38.754189 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b334e-817b-43b9-b943-015884a748f6 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:38.754608 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b334e-817b-43b9-b943-015884a748f6 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:38.754734 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b334e-817b-43b9-b943-015884a748f6 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:38.756328 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 516/1062] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:44:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 18 00:44:38.761939 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1815144-b152-404a-ab43-e3417e913737 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:38.762261 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1815144-b152-404a-ab43-e3417e913737 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:38.762494 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1815144-b152-404a-ab43-e3417e913737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:38.782655 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-b1815144-b152-404a-ab43-e3417e913737 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:44:38.783933 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-b1815144-b152-404a-ab43-e3417e913737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:44:38.790150 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30b334e-817b-43b9-b943-015884a748f6 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:38.874005 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 547/1063] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:44:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 00:44:38.904800 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:38.917173 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30b334e-817b-43b9-b943-015884a748f6 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:38.977201 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f1af9-1354-4060-88c4-ef487030adde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:38.977845 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f1af9-1354-4060-88c4-ef487030adde None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:38.978123 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f1af9-1354-4060-88c4-ef487030adde None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:38.978399 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f1af9-1354-4060-88c4-ef487030adde None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:39.068269 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0f1af9-1354-4060-88c4-ef487030adde None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:39.070620 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0f1af9-1354-4060-88c4-ef487030adde None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:39.144167 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1815144-b152-404a-ab43-e3417e913737 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:39.192748 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:39.200459 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 517/1064] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Sep 18 00:44:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 18 00:44:39.207015 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f1af9-1354-4060-88c4-ef487030adde None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:39.244909 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:39.274316 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1815144-b152-404a-ab43-e3417e913737 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:39.328957 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f1af9-1354-4060-88c4-ef487030adde None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:39.332478 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d789cb87-a092-497f-a734-64fd5851bd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:39.334474 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d789cb87-a092-497f-a734-64fd5851bd20 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:39.334474 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d789cb87-a092-497f-a734-64fd5851bd20 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:39.334474 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d789cb87-a092-497f-a734-64fd5851bd20 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:39.346174 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d789cb87-a092-497f-a734-64fd5851bd20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:44:39.351046 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-d789cb87-a092-497f-a734-64fd5851bd20 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 00:44:39.351046 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:39.351046 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:44:39.351046 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:44:39.351046 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:44:39.351046 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:44:39.351046 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:44:39.351046 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:44:39.351046 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:44:39.351046 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:44:39.351046 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:44:39.351046 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:44:39.351046 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:44:39.351046 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:44:39.351046 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:44:39.351046 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:44:39.352209 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:44:39.352209 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:44:39.352209 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:44:39.352209 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:44:39.352209 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:44:39.352209 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:44:39.352209 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:44:39.352209 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:44:39.352209 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:44:39.352209 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:44:39.352209 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:44:39.352209 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:44:39.352209 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:44:39.352209 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:44:39.352209 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:44:39.352209 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:44:39.353980 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:44:39.353980 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:44:39.353980 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:44:39.353980 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:44:39.353980 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:44:39.353980 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:44:39.353980 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:44:39.353980 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:44:39.353980 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:44:39.353980 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:44:39.353980 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 00:44:39.353980 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:44:39.353980 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 548/1065] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Sep 18 00:44:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 00:44:39.358917 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d789cb87-a092-497f-a734-64fd5851bd20 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:39.397982 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf36576c-2732-4e2c-82d8-9e943a26215c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:39.399066 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf36576c-2732-4e2c-82d8-9e943a26215c None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:39.399559 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf36576c-2732-4e2c-82d8-9e943a26215c None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:39.400046 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf36576c-2732-4e2c-82d8-9e943a26215c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:39.422866 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf36576c-2732-4e2c-82d8-9e943a26215c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:39.424401 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf36576c-2732-4e2c-82d8-9e943a26215c None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:39.440267 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-bf36576c-2732-4e2c-82d8-9e943a26215c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:44:39.440267 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:39.440267 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:44:39.440267 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:44:39.440267 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:44:39.440267 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:44:39.440267 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:44:39.440267 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:44:39.440267 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:44:39.440267 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:44:39.440267 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:44:39.440267 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:44:39.440267 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:44:39.440267 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:44:39.440267 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:44:39.440267 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:44:39.441271 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:44:39.441271 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:44:39.441271 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:44:39.441271 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:44:39.441271 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:44:39.441271 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:44:39.441271 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:44:39.441271 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:44:39.441271 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:44:39.441271 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:44:39.441271 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:44:39.441271 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:44:39.441271 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:44:39.441271 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:44:39.441271 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:44:39.441271 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:44:39.441271 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:44:39.442227 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:44:39.442227 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:44:39.442227 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:44:39.446521 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 518/1066] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:44:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 00:44:39.447431 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf36576c-2732-4e2c-82d8-9e943a26215c None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:39.523432 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:39.529299 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d789cb87-a092-497f-a734-64fd5851bd20 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:39.587534 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf36576c-2732-4e2c-82d8-9e943a26215c None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:39.592443 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5425593c-1363-467d-8d68-e01a01ad5840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:39.593461 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425593c-1363-467d-8d68-e01a01ad5840 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:39.593950 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425593c-1363-467d-8d68-e01a01ad5840 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:39.594446 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425593c-1363-467d-8d68-e01a01ad5840 None admin] PATH_INFO: `/v3/roles` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:39.595675 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5425593c-1363-467d-8d68-e01a01ad5840 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:39.596256 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5425593c-1363-467d-8d68-e01a01ad5840 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:39.598918 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5425593c-1363-467d-8d68-e01a01ad5840 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:39.620293 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 549/1067] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Sep 18 00:44:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:44:39.622045 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5425593c-1363-467d-8d68-e01a01ad5840 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:39.626372 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:39.640270 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb508d75-5e7a-410b-9029-178a610f5f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:39.640906 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb508d75-5e7a-410b-9029-178a610f5f6d None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:39.641185 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb508d75-5e7a-410b-9029-178a610f5f6d None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:39.641454 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb508d75-5e7a-410b-9029-178a610f5f6d None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:39.642124 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb508d75-5e7a-410b-9029-178a610f5f6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:39.642428 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb508d75-5e7a-410b-9029-178a610f5f6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:39.643861 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb508d75-5e7a-410b-9029-178a610f5f6d None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:39.657759 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 519/1068] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:44:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:44:39.785199 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5425593c-1363-467d-8d68-e01a01ad5840 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:39.836153 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8601ed37-d26b-4b2d-88aa-8dadc68ae5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:39.837200 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8601ed37-d26b-4b2d-88aa-8dadc68ae5fb None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:39.837521 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8601ed37-d26b-4b2d-88aa-8dadc68ae5fb None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:39.837872 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8601ed37-d26b-4b2d-88aa-8dadc68ae5fb None admin] PATH_INFO: `/v3/users/878c3f94dfd240e698abe85f49694158` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:39.839809 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8601ed37-d26b-4b2d-88aa-8dadc68ae5fb None admin] RBAC: Authorizing `identity:get_user(user_id=878c3f94dfd240e698abe85f49694158)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:39.844880 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8601ed37-d26b-4b2d-88aa-8dadc68ae5fb None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:39.848411 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 550/1069] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Sep 18 00:44:39 2022] GET /identity/v3/users/878c3f94dfd240e698abe85f49694158 => generated 285 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:44:39.862544 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb508d75-5e7a-410b-9029-178a610f5f6d None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:39.999980 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb508d75-5e7a-410b-9029-178a610f5f6d None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:40.010356 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:40.037706 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e99cc-de60-47d9-a052-c5d13c83de8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:40.038346 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e99cc-de60-47d9-a052-c5d13c83de8f None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:40.038625 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e99cc-de60-47d9-a052-c5d13c83de8f None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:40.038898 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e99cc-de60-47d9-a052-c5d13c83de8f None admin] PATH_INFO: `/v3/projects/950f1f754e7b45f8981f323d44fc0803` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:40.040072 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6e99cc-de60-47d9-a052-c5d13c83de8f None admin] RBAC: Authorizing `identity:get_project(project_id=950f1f754e7b45f8981f323d44fc0803)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:40.041783 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6e99cc-de60-47d9-a052-c5d13c83de8f None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:40.043466 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 520/1070] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Sep 18 00:44:39 2022] GET /identity/v3/projects/950f1f754e7b45f8981f323d44fc0803 => generated 311 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:44:40.050063 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8601ed37-d26b-4b2d-88aa-8dadc68ae5fb None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:40.122984 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:40.155364 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8601ed37-d26b-4b2d-88aa-8dadc68ae5fb None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:40.189670 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad0d1a0-3ead-4af9-92fb-34589d05594e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:40.190351 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0d1a0-3ead-4af9-92fb-34589d05594e None admin] REQUEST_METHOD: `PUT` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:40.190633 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0d1a0-3ead-4af9-92fb-34589d05594e None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:40.190909 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0d1a0-3ead-4af9-92fb-34589d05594e None admin] PATH_INFO: `/v3/projects/950f1f754e7b45f8981f323d44fc0803/users/878c3f94dfd240e698abe85f49694158/roles/591d4711dc204cf98003c8b7d7558506` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:40.192875 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad0d1a0-3ead-4af9-92fb-34589d05594e None admin] RBAC: Authorizing `identity:create_grant(project_id=950f1f754e7b45f8981f323d44fc0803, user_id=878c3f94dfd240e698abe85f49694158, role_id=591d4711dc204cf98003c8b7d7558506)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:40.194331 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad0d1a0-3ead-4af9-92fb-34589d05594e None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:40.216485 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 551/1071] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Sep 18 00:44:40 2022] PUT /identity/v3/projects/950f1f754e7b45f8981f323d44fc0803/users/878c3f94dfd240e698abe85f49694158/roles/591d4711dc204cf98003c8b7d7558506 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 00:44:40.463389 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7babe69-60ac-46b8-9524-147e7c0b999b None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:40.463946 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7babe69-60ac-46b8-9524-147e7c0b999b None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:40.463946 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7babe69-60ac-46b8-9524-147e7c0b999b None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:40.465288 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 521/1072] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:44:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:44:40.471423 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25e48c-9023-411e-9bb7-d0adee113c7a None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:40.472181 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25e48c-9023-411e-9bb7-d0adee113c7a None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:40.472181 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25e48c-9023-411e-9bb7-d0adee113c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:40.490991 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-4b25e48c-9023-411e-9bb7-d0adee113c7a None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:44:40.492309 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-4b25e48c-9023-411e-9bb7-d0adee113c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:44:40.577199 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 552/1073] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:44:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 00:44:40.848064 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7babe69-60ac-46b8-9524-147e7c0b999b None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:40.955580 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7babe69-60ac-46b8-9524-147e7c0b999b None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:40.992214 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b90ae54-e329-409f-9185-9b559cd6f9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:40.992853 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b90ae54-e329-409f-9185-9b559cd6f9bf None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:40.993134 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b90ae54-e329-409f-9185-9b559cd6f9bf None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:40.993409 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b90ae54-e329-409f-9185-9b559cd6f9bf None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:41.004684 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b90ae54-e329-409f-9185-9b559cd6f9bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:44:41.009530 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-1b90ae54-e329-409f-9185-9b559cd6f9bf None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 18 00:44:41.009530 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:41.009530 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:44:41.009530 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:44:41.009530 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:44:41.009530 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:44:41.009530 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:44:41.009530 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:44:41.009530 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:44:41.009530 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:44:41.009530 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:44:41.009530 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:44:41.009530 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:44:41.009530 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:44:41.009530 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:44:41.009530 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:44:41.010780 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:44:41.010780 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:44:41.010780 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:44:41.010780 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:44:41.010780 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:44:41.010780 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:44:41.010780 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:44:41.010780 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:44:41.010780 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:44:41.010780 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:44:41.010780 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:44:41.010780 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:44:41.010780 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:44:41.010780 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:44:41.010780 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:44:41.010780 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:44:41.011623 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:44:41.011623 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:44:41.011623 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:44:41.011623 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:44:41.011623 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:44:41.011623 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:44:41.011623 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:44:41.011623 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:44:41.011623 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:44:41.011623 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:44:41.011623 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 18 00:44:41.011623 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:44:41.011623 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 522/1074] 10.222.0.15 () {56 vars in 1120 bytes} [Sun Sep 18 00:44:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:44:41.017709 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b25e48c-9023-411e-9bb7-d0adee113c7a None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:41.086155 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:41.132230 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b25e48c-9023-411e-9bb7-d0adee113c7a None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:41.168125 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb9aab8-00a1-47df-985b-92418d1b608f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:41.168732 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9aab8-00a1-47df-985b-92418d1b608f None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:41.169008 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9aab8-00a1-47df-985b-92418d1b608f None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:41.169278 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9aab8-00a1-47df-985b-92418d1b608f None admin] PATH_INFO: `/v3/roles` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:41.169944 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb9aab8-00a1-47df-985b-92418d1b608f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:41.170246 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb9aab8-00a1-47df-985b-92418d1b608f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:41.171650 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb9aab8-00a1-47df-985b-92418d1b608f None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:41.184174 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 553/1075] 10.222.0.15 () {56 vars in 1115 bytes} [Sun Sep 18 00:44:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:41.190372 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b90ae54-e329-409f-9185-9b559cd6f9bf None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:41.228667 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:41.299036 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b90ae54-e329-409f-9185-9b559cd6f9bf None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:41.334220 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6ff78-e3d8-4a15-b77d-02023e99c632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:41.334859 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6ff78-e3d8-4a15-b77d-02023e99c632 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:41.335139 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6ff78-e3d8-4a15-b77d-02023e99c632 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:41.335406 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6ff78-e3d8-4a15-b77d-02023e99c632 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:41.346628 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e6ff78-e3d8-4a15-b77d-02023e99c632 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:41.348122 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e6ff78-e3d8-4a15-b77d-02023e99c632 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:41.363668 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-53e6ff78-e3d8-4a15-b77d-02023e99c632 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:44:41.363668 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:41.363668 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:44:41.363668 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:44:41.363668 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:44:41.363668 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:44:41.363668 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:44:41.363668 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:44:41.363668 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:44:41.363668 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:44:41.363668 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:44:41.363668 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:44:41.363668 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:44:41.363668 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:44:41.363668 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:44:41.363668 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:44:41.364708 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:44:41.364708 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:44:41.364708 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:44:41.364708 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:44:41.364708 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:44:41.364708 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:44:41.364708 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:44:41.364708 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:44:41.364708 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:44:41.364708 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:44:41.364708 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:44:41.364708 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:44:41.364708 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:44:41.364708 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:44:41.364708 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:44:41.364708 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:44:41.364708 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:44:41.365739 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:44:41.365739 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:44:41.365739 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:44:41.368068 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 523/1076] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:44:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:44:41.370579 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb9aab8-00a1-47df-985b-92418d1b608f None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:41.494721 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb9aab8-00a1-47df-985b-92418d1b608f None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:41.518524 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:41.530644 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ceacb2-13a8-4b48-ad6c-13b386faefcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:41.531263 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ceacb2-13a8-4b48-ad6c-13b386faefcb None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:41.531569 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ceacb2-13a8-4b48-ad6c-13b386faefcb None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:41.531840 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ceacb2-13a8-4b48-ad6c-13b386faefcb None admin] PATH_INFO: `/v3/domains` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:41.532507 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ceacb2-13a8-4b48-ad6c-13b386faefcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:41.532807 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ceacb2-13a8-4b48-ad6c-13b386faefcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:41.534185 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ceacb2-13a8-4b48-ad6c-13b386faefcb None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:41.547767 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 554/1077] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:44:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:41.553458 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6ff78-e3d8-4a15-b77d-02023e99c632 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:41.649267 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:41.663183 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6ff78-e3d8-4a15-b77d-02023e99c632 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:41.698609 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc844bd-1c87-42ba-80e2-11ea87358c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:41.699251 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc844bd-1c87-42ba-80e2-11ea87358c73 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:41.699536 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc844bd-1c87-42ba-80e2-11ea87358c73 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:41.699815 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc844bd-1c87-42ba-80e2-11ea87358c73 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:41.708631 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc844bd-1c87-42ba-80e2-11ea87358c73 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:41.710078 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc844bd-1c87-42ba-80e2-11ea87358c73 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:41.722313 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-acc844bd-1c87-42ba-80e2-11ea87358c73 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 18 00:44:41.722313 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:41.722313 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:44:41.722313 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:44:41.722313 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:44:41.722313 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:44:41.722313 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:44:41.722313 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:44:41.722313 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:44:41.722313 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:44:41.722313 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:44:41.722313 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:44:41.722313 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 00:44:41.722313 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 00:44:41.722313 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 00:44:41.722313 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 00:44:41.731495 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:44:41.731495 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:44:41.731495 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 00:44:41.731495 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:44:41.731495 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 00:44:41.731495 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:44:41.731495 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:44:41.731495 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:44:41.731495 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:44:41.731495 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:44:41.731495 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:44:41.731495 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:44:41.731495 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:44:41.731495 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:44:41.731495 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:44:41.731495 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:44:41.731495 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:44:41.731495 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:44:41.733392 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:44:41.733392 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:44:41.733392 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 00:44:41.733392 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 00:44:41.733392 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 00:44:41.733392 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 00:44:41.733392 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 00:44:41.733392 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 00:44:41.733392 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 18 00:44:41.733392 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:44:41.733392 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 524/1078] 10.222.0.15 () {56 vars in 1093 bytes} [Sun Sep 18 00:44:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:44:41.734765 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ceacb2-13a8-4b48-ad6c-13b386faefcb None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:41.846365 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ceacb2-13a8-4b48-ad6c-13b386faefcb None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:41.897420 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222adb26-286e-473c-9c0e-bf8d2eb21ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:41.898261 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222adb26-286e-473c-9c0e-bf8d2eb21ae3 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:41.898542 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222adb26-286e-473c-9c0e-bf8d2eb21ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:41.898810 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222adb26-286e-473c-9c0e-bf8d2eb21ae3 None admin] PATH_INFO: `/v3/users` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:41.899582 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222adb26-286e-473c-9c0e-bf8d2eb21ae3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:41.899916 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222adb26-286e-473c-9c0e-bf8d2eb21ae3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:41.901820 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222adb26-286e-473c-9c0e-bf8d2eb21ae3 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:41.922569 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 555/1079] 10.222.0.15 () {56 vars in 1133 bytes} [Sun Sep 18 00:44:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:44:41.928553 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc844bd-1c87-42ba-80e2-11ea87358c73 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:42.039409 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc844bd-1c87-42ba-80e2-11ea87358c73 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:42.077047 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35eff2e-f46d-404d-bc5f-d83095abdd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:42.077690 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35eff2e-f46d-404d-bc5f-d83095abdd2a None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:42.077977 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35eff2e-f46d-404d-bc5f-d83095abdd2a None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:42.078243 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35eff2e-f46d-404d-bc5f-d83095abdd2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:42.089960 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35eff2e-f46d-404d-bc5f-d83095abdd2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:42.091419 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35eff2e-f46d-404d-bc5f-d83095abdd2a None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:42.100538 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:42.108920 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-a35eff2e-f46d-404d-bc5f-d83095abdd2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:44:42.108920 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:42.108920 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:44:42.108920 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:44:42.108920 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:44:42.108920 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:44:42.108920 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:44:42.108920 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:44:42.108920 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:44:42.108920 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:44:42.108920 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:44:42.108920 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:44:42.108920 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:44:42.108920 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:44:42.108920 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:44:42.108920 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:44:42.109926 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:44:42.109926 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:44:42.109926 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:44:42.109926 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:44:42.109926 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:44:42.109926 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:44:42.109926 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:44:42.109926 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:44:42.109926 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:44:42.109926 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:44:42.109926 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:44:42.109926 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:44:42.109926 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:44:42.109926 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:44:42.109926 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:44:42.109926 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:44:42.109926 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:44:42.115783 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:44:42.115783 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:44:42.115783 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:44:42.115783 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 525/1080] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:44:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:44:42.116457 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222adb26-286e-473c-9c0e-bf8d2eb21ae3 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:42.164561 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:42.232389 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222adb26-286e-473c-9c0e-bf8d2eb21ae3 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:42.273672 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f918acdc-fb0d-487a-a660-66e227b66e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:42.274293 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918acdc-fb0d-487a-a660-66e227b66e35 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:42.274571 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918acdc-fb0d-487a-a660-66e227b66e35 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:42.274843 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918acdc-fb0d-487a-a660-66e227b66e35 None admin] PATH_INFO: `/v3/domains` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:42.275491 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f918acdc-fb0d-487a-a660-66e227b66e35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:42.275799 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f918acdc-fb0d-487a-a660-66e227b66e35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:42.277197 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f918acdc-fb0d-487a-a660-66e227b66e35 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:42.289968 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 556/1081] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:44:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:42.296520 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35eff2e-f46d-404d-bc5f-d83095abdd2a None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:42.425593 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35eff2e-f46d-404d-bc5f-d83095abdd2a None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:42.462718 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6693340e-cab9-4966-9b9a-cee8673895ad None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:42.463102 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6693340e-cab9-4966-9b9a-cee8673895ad None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:42.463464 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6693340e-cab9-4966-9b9a-cee8673895ad None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:42.465387 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 557/1082] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:44:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 18 00:44:42.466791 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053cd638-5a4a-45b2-a6a7-4f0a2915d47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:42.468289 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053cd638-5a4a-45b2-a6a7-4f0a2915d47d None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:42.468742 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053cd638-5a4a-45b2-a6a7-4f0a2915d47d None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:42.469159 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053cd638-5a4a-45b2-a6a7-4f0a2915d47d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:42.475190 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e7d48-276b-4b2f-bfa0-6102029f8f8f None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:42.475680 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e7d48-276b-4b2f-bfa0-6102029f8f8f None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:42.476241 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e7d48-276b-4b2f-bfa0-6102029f8f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:42.478815 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053cd638-5a4a-45b2-a6a7-4f0a2915d47d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:42.480345 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053cd638-5a4a-45b2-a6a7-4f0a2915d47d None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:42.494288 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-053cd638-5a4a-45b2-a6a7-4f0a2915d47d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:44:42.494288 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:42.494288 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:44:42.494288 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:44:42.494288 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:44:42.494288 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:44:42.494288 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:44:42.494288 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:44:42.494288 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:44:42.494288 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:44:42.494288 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:44:42.494288 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:44:42.494288 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 00:44:42.494288 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 00:44:42.494288 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 00:44:42.495242 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 00:44:42.495242 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:44:42.495242 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:44:42.495242 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:44:42.495242 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:44:42.495242 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:44:42.495242 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:44:42.495242 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:44:42.495242 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:44:42.495242 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:44:42.495242 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:44:42.495242 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:44:42.495242 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:44:42.495242 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:44:42.495242 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:44:42.495242 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:44:42.495242 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:44:42.496190 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 00:44:42.496190 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 00:44:42.496190 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 00:44:42.496190 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 00:44:42.496190 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 00:44:42.496190 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 00:44:42.496190 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:44:42.496190 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:44:42.496190 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 526/1083] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Sep 18 00:44:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:44:42.502301 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053cd638-5a4a-45b2-a6a7-4f0a2915d47d None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:42.510722 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-910e7d48-276b-4b2f-bfa0-6102029f8f8f None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:44:42.512296 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-910e7d48-276b-4b2f-bfa0-6102029f8f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:44:42.603606 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:42.625777 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 558/1084] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:44:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 00:44:42.680415 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053cd638-5a4a-45b2-a6a7-4f0a2915d47d None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:42.720783 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f720e13e-ea1c-4e84-9099-1b8cc03f08d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:42.721410 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720e13e-ea1c-4e84-9099-1b8cc03f08d4 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:42.721707 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720e13e-ea1c-4e84-9099-1b8cc03f08d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:42.721974 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720e13e-ea1c-4e84-9099-1b8cc03f08d4 None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:42.722672 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f720e13e-ea1c-4e84-9099-1b8cc03f08d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:42.722979 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f720e13e-ea1c-4e84-9099-1b8cc03f08d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:42.724472 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f720e13e-ea1c-4e84-9099-1b8cc03f08d4 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:42.739306 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 527/1085] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Sep 18 00:44:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:44:42.746014 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e7d48-276b-4b2f-bfa0-6102029f8f8f None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:42.803076 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:42.899140 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e7d48-276b-4b2f-bfa0-6102029f8f8f None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:42.934373 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f720e13e-ea1c-4e84-9099-1b8cc03f08d4 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:42.941313 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52d3b09-8eb3-4bdc-b020-e3cb86f0681e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:42.942017 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d3b09-8eb3-4bdc-b020-e3cb86f0681e None admin] REQUEST_METHOD: `PUT` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:42.942298 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d3b09-8eb3-4bdc-b020-e3cb86f0681e None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:42.942575 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d3b09-8eb3-4bdc-b020-e3cb86f0681e None admin] PATH_INFO: `/v3/projects/52ebde8fa3f84ede9ef575f7c0780798/users/264c183fff8a49478eea4aceea73273e/roles/5e489759b2bc48d6b3895ed9d1f79f19` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:42.945449 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52d3b09-8eb3-4bdc-b020-e3cb86f0681e None admin] RBAC: Authorizing `identity:create_grant(project_id=52ebde8fa3f84ede9ef575f7c0780798, user_id=264c183fff8a49478eea4aceea73273e, role_id=5e489759b2bc48d6b3895ed9d1f79f19)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:42.947134 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52d3b09-8eb3-4bdc-b020-e3cb86f0681e None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:42.962588 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 559/1086] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Sep 18 00:44:42 2022] PUT /identity/v3/projects/52ebde8fa3f84ede9ef575f7c0780798/users/264c183fff8a49478eea4aceea73273e/roles/5e489759b2bc48d6b3895ed9d1f79f19 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 00:44:43.058150 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f720e13e-ea1c-4e84-9099-1b8cc03f08d4 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:43.082293 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:43.098890 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dadc85-0b0c-43e8-9cd2-a0e91238ce7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:43.099564 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dadc85-0b0c-43e8-9cd2-a0e91238ce7e None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:43.099849 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dadc85-0b0c-43e8-9cd2-a0e91238ce7e None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:43.100158 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dadc85-0b0c-43e8-9cd2-a0e91238ce7e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:43.112776 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dadc85-0b0c-43e8-9cd2-a0e91238ce7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:44:43.117825 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-86dadc85-0b0c-43e8-9cd2-a0e91238ce7e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 00:44:43.117825 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:43.117825 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:44:43.117825 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:44:43.117825 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:44:43.117825 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:44:43.117825 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:44:43.117825 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:44:43.117825 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:44:43.117825 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:44:43.117825 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:44:43.117825 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:44:43.117825 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:44:43.117825 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:44:43.117825 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:44:43.117825 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:44:43.118986 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:44:43.118986 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:44:43.118986 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:44:43.118986 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:44:43.118986 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:44:43.118986 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:44:43.118986 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:44:43.118986 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:44:43.118986 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:44:43.118986 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:44:43.118986 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:44:43.118986 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:44:43.118986 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:44:43.118986 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:44:43.118986 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:44:43.118986 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:44:43.119878 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:44:43.119878 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:44:43.119878 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:44:43.119878 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:44:43.119878 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:44:43.119878 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:44:43.119878 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:44:43.119878 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:44:43.119878 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:44:43.119878 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:44:43.119878 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 00:44:43.119878 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:44:43.119878 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 528/1087] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Sep 18 00:44:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 00:44:43.125463 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52d3b09-8eb3-4bdc-b020-e3cb86f0681e None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:43.221374 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:43.232214 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52d3b09-8eb3-4bdc-b020-e3cb86f0681e None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:43.266901 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d709d5-bba4-427b-bb39-0e9a896490c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:43.267513 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d709d5-bba4-427b-bb39-0e9a896490c7 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:43.267796 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d709d5-bba4-427b-bb39-0e9a896490c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:43.268098 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d709d5-bba4-427b-bb39-0e9a896490c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:43.268761 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d709d5-bba4-427b-bb39-0e9a896490c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:43.269064 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d709d5-bba4-427b-bb39-0e9a896490c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:43.270430 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d709d5-bba4-427b-bb39-0e9a896490c7 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:43.279120 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 560/1088] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Sep 18 00:44:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:43.285708 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dadc85-0b0c-43e8-9cd2-a0e91238ce7e None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:43.390158 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dadc85-0b0c-43e8-9cd2-a0e91238ce7e None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:43.426033 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d376713-8bc4-4095-9f0b-f0bc52a404f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:43.426677 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d376713-8bc4-4095-9f0b-f0bc52a404f2 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:43.426959 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d376713-8bc4-4095-9f0b-f0bc52a404f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:43.427236 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d376713-8bc4-4095-9f0b-f0bc52a404f2 None admin] PATH_INFO: `/v3/users/878c3f94dfd240e698abe85f49694158` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:43.428394 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d376713-8bc4-4095-9f0b-f0bc52a404f2 None admin] RBAC: Authorizing `identity:get_user(user_id=878c3f94dfd240e698abe85f49694158)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:43.429844 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d376713-8bc4-4095-9f0b-f0bc52a404f2 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:43.431603 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 529/1089] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Sep 18 00:44:43 2022] GET /identity/v3/users/878c3f94dfd240e698abe85f49694158 => generated 285 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:43.437858 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d709d5-bba4-427b-bb39-0e9a896490c7 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:43.546199 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d709d5-bba4-427b-bb39-0e9a896490c7 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:43.580247 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f936e1cc-5085-4fc1-9bb2-2d9ec7e8a965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:43.580865 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f936e1cc-5085-4fc1-9bb2-2d9ec7e8a965 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:43.581147 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f936e1cc-5085-4fc1-9bb2-2d9ec7e8a965 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:43.581421 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f936e1cc-5085-4fc1-9bb2-2d9ec7e8a965 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:43.602991 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:43.650096 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f936e1cc-5085-4fc1-9bb2-2d9ec7e8a965 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:43.651558 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f936e1cc-5085-4fc1-9bb2-2d9ec7e8a965 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:43.753520 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 561/1090] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Sep 18 00:44:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 18 00:44:43.759455 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d376713-8bc4-4095-9f0b-f0bc52a404f2 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:43.811842 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:43.863157 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d376713-8bc4-4095-9f0b-f0bc52a404f2 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:43.899208 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7ccdaf-0ea5-408f-8ba2-bc02524b4030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:43.899850 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ccdaf-0ea5-408f-8ba2-bc02524b4030 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:43.900180 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ccdaf-0ea5-408f-8ba2-bc02524b4030 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:43.900441 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ccdaf-0ea5-408f-8ba2-bc02524b4030 None admin] PATH_INFO: `/v3/projects/950f1f754e7b45f8981f323d44fc0803` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:43.901558 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7ccdaf-0ea5-408f-8ba2-bc02524b4030 None admin] RBAC: Authorizing `identity:get_project(project_id=950f1f754e7b45f8981f323d44fc0803)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:43.903024 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7ccdaf-0ea5-408f-8ba2-bc02524b4030 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:43.909659 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 530/1091] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Sep 18 00:44:43 2022] GET /identity/v3/projects/950f1f754e7b45f8981f323d44fc0803 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:43.910920 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f936e1cc-5085-4fc1-9bb2-2d9ec7e8a965 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:43.965193 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:44.012172 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f936e1cc-5085-4fc1-9bb2-2d9ec7e8a965 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:44.046367 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9959f05b-5a53-47a1-a37a-2e9ab75752b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:44.046975 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959f05b-5a53-47a1-a37a-2e9ab75752b5 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:44.047256 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959f05b-5a53-47a1-a37a-2e9ab75752b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:44.047528 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959f05b-5a53-47a1-a37a-2e9ab75752b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:44.048284 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9959f05b-5a53-47a1-a37a-2e9ab75752b5 None admin] RBAC: Adding query filter params (role.id=591d4711dc204cf98003c8b7d7558506, scope.project.id=950f1f754e7b45f8981f323d44fc0803, user.id=878c3f94dfd240e698abe85f49694158) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:44.048594 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9959f05b-5a53-47a1-a37a-2e9ab75752b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:44.050027 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9959f05b-5a53-47a1-a37a-2e9ab75752b5 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:44.068008 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 562/1092] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Sep 18 00:44:43 2022] GET /identity/v3/role_assignments?user.id=878c3f94dfd240e698abe85f49694158&scope.project.id=950f1f754e7b45f8981f323d44fc0803&role.id=591d4711dc204cf98003c8b7d7558506 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:45.169321 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ef3e9-74ff-4450-81a3-c70a6a759103 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:45.169905 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ef3e9-74ff-4450-81a3-c70a6a759103 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:45.169905 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ef3e9-74ff-4450-81a3-c70a6a759103 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:45.171249 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 531/1093] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:44:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:44:45.176923 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87314583-aabc-4a0b-9d40-0f219fc8181e None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:45.177362 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87314583-aabc-4a0b-9d40-0f219fc8181e None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:45.177605 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87314583-aabc-4a0b-9d40-0f219fc8181e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:45.198019 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-87314583-aabc-4a0b-9d40-0f219fc8181e None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:44:45.199238 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-87314583-aabc-4a0b-9d40-0f219fc8181e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:44:45.269234 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 563/1094] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:44:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 00:44:45.561889 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096ef3e9-74ff-4450-81a3-c70a6a759103 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:45.685708 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096ef3e9-74ff-4450-81a3-c70a6a759103 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:45.705039 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:45.724224 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4325e5e-564e-44c2-9faa-bc4398d665bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:45.724777 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4325e5e-564e-44c2-9faa-bc4398d665bb None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:45.725058 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4325e5e-564e-44c2-9faa-bc4398d665bb None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:45.725332 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4325e5e-564e-44c2-9faa-bc4398d665bb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:45.739304 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4325e5e-564e-44c2-9faa-bc4398d665bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:44:45.744245 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-e4325e5e-564e-44c2-9faa-bc4398d665bb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 18 00:44:45.744245 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:45.744245 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:44:45.744245 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:44:45.744245 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:44:45.744245 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:44:45.744245 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:44:45.744245 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:44:45.744245 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:44:45.744245 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:44:45.744245 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:44:45.744245 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:44:45.744245 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:44:45.744245 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:44:45.744245 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:44:45.744245 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:44:45.745322 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:44:45.745322 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:44:45.745322 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:44:45.745322 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:44:45.745322 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:44:45.745322 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:44:45.745322 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:44:45.745322 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:44:45.745322 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:44:45.745322 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:44:45.745322 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:44:45.745322 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:44:45.745322 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:44:45.745322 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:44:45.745322 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:44:45.745322 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:44:45.746821 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:44:45.746821 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:44:45.746821 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:44:45.746821 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:44:45.746821 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:44:45.746821 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:44:45.746821 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:44:45.746821 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:44:45.746821 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:44:45.746821 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:44:45.746821 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 18 00:44:45.746821 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:44:45.746821 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 532/1095] 10.222.0.15 () {56 vars in 1120 bytes} [Sun Sep 18 00:44:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:44:45.751528 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87314583-aabc-4a0b-9d40-0f219fc8181e None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:45.814507 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:45.885166 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87314583-aabc-4a0b-9d40-0f219fc8181e None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:45.923266 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f90a3d-80eb-4966-bb66-726ed8764a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:45.923884 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f90a3d-80eb-4966-bb66-726ed8764a2c None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:45.924187 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f90a3d-80eb-4966-bb66-726ed8764a2c None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:45.924458 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f90a3d-80eb-4966-bb66-726ed8764a2c None admin] PATH_INFO: `/v3/roles` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:45.925126 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f90a3d-80eb-4966-bb66-726ed8764a2c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:45.925424 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f90a3d-80eb-4966-bb66-726ed8764a2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:45.926795 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f90a3d-80eb-4966-bb66-726ed8764a2c None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:45.935415 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 564/1096] 10.222.0.15 () {56 vars in 1115 bytes} [Sun Sep 18 00:44:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:45.941454 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4325e5e-564e-44c2-9faa-bc4398d665bb None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:46.077340 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4325e5e-564e-44c2-9faa-bc4398d665bb None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:46.115379 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f11c20-def6-483e-9931-5633baacd475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:46.116046 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f11c20-def6-483e-9931-5633baacd475 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:46.116326 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f11c20-def6-483e-9931-5633baacd475 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:46.116597 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f11c20-def6-483e-9931-5633baacd475 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:46.127956 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f11c20-def6-483e-9931-5633baacd475 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:46.129420 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f11c20-def6-483e-9931-5633baacd475 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:46.144692 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-e8f11c20-def6-483e-9931-5633baacd475 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:44:46.144692 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:46.144692 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:44:46.144692 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:44:46.144692 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:44:46.144692 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:44:46.144692 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:44:46.144692 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:44:46.144692 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:44:46.144692 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:44:46.144692 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:44:46.144692 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:44:46.144692 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:44:46.144692 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:44:46.144692 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:44:46.144692 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:44:46.146775 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:44:46.146775 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:44:46.146775 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:44:46.146775 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:44:46.146775 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:44:46.146775 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:44:46.146775 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:44:46.146775 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:44:46.146775 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:44:46.146775 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:44:46.146775 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:44:46.146775 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:44:46.146775 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:44:46.146775 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:44:46.146775 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:44:46.146775 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:44:46.146775 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:44:46.148711 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:44:46.148711 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:44:46.148711 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:44:46.148711 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 533/1097] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:44:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:44:46.153455 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f90a3d-80eb-4966-bb66-726ed8764a2c None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:46.287215 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f90a3d-80eb-4966-bb66-726ed8764a2c None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:46.299575 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:46.330782 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f5a3b-bc00-41a5-8834-0ab9e1018583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:46.331324 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f5a3b-bc00-41a5-8834-0ab9e1018583 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:46.331604 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f5a3b-bc00-41a5-8834-0ab9e1018583 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:46.331877 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f5a3b-bc00-41a5-8834-0ab9e1018583 None admin] PATH_INFO: `/v3/domains` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:46.332565 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f5a3b-bc00-41a5-8834-0ab9e1018583 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:46.332875 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f5a3b-bc00-41a5-8834-0ab9e1018583 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:46.334285 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f5a3b-bc00-41a5-8834-0ab9e1018583 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:46.347677 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 565/1098] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:44:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:46.354523 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f11c20-def6-483e-9931-5633baacd475 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:46.388985 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:46.403640 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd168c-5adc-4f60-a9bc-2df978b6110b None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:46.404377 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd168c-5adc-4f60-a9bc-2df978b6110b None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:46.404729 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd168c-5adc-4f60-a9bc-2df978b6110b None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:46.406722 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 566/1099] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:44:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 18 00:44:46.412250 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e98eb-6890-4e12-9c35-15099ed00bd2 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:46.412547 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e98eb-6890-4e12-9c35-15099ed00bd2 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:46.412827 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e98eb-6890-4e12-9c35-15099ed00bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:46.432181 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-021e98eb-6890-4e12-9c35-15099ed00bd2 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:44:46.433409 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-021e98eb-6890-4e12-9c35-15099ed00bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:44:46.472723 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f11c20-def6-483e-9931-5633baacd475 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:46.508111 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 567/1100] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:44:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 18 00:44:46.508436 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d047d-bfde-4cbd-bb9d-ed1d775805fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:46.508911 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d047d-bfde-4cbd-bb9d-ed1d775805fa None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:46.509202 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d047d-bfde-4cbd-bb9d-ed1d775805fa None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:46.509480 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d047d-bfde-4cbd-bb9d-ed1d775805fa None admin] PATH_INFO: `/v3/users/nova` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:46.519166 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66d047d-bfde-4cbd-bb9d-ed1d775805fa None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:46.521039 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66d047d-bfde-4cbd-bb9d-ed1d775805fa None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:46.536038 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-d66d047d-bfde-4cbd-bb9d-ed1d775805fa None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 18 00:44:46.536038 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:46.536038 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:44:46.536038 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:44:46.536038 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:44:46.536038 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:44:46.536038 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:44:46.536038 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:44:46.536038 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:44:46.536038 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:44:46.536038 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:44:46.536038 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:44:46.536038 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 00:44:46.536038 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 00:44:46.536038 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 00:44:46.536038 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 00:44:46.537083 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:44:46.537083 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:44:46.537083 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 00:44:46.537083 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:44:46.537083 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 00:44:46.537083 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:44:46.537083 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:44:46.537083 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:44:46.537083 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:44:46.537083 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:44:46.537083 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:44:46.537083 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:44:46.537083 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:44:46.537083 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:44:46.537083 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:44:46.537083 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:44:46.537083 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:44:46.537083 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:44:46.538179 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:44:46.538179 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:44:46.538179 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 00:44:46.538179 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 00:44:46.538179 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 00:44:46.538179 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 00:44:46.538179 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 00:44:46.538179 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 00:44:46.538179 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 18 00:44:46.538179 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:44:46.538179 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 534/1101] 10.222.0.15 () {56 vars in 1093 bytes} [Sun Sep 18 00:44:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:44:46.543666 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e98eb-6890-4e12-9c35-15099ed00bd2 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:46.659413 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:46.663832 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e98eb-6890-4e12-9c35-15099ed00bd2 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:46.701153 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f60d25-6f66-4dee-8e21-d5d29225da15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:46.702329 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f60d25-6f66-4dee-8e21-d5d29225da15 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:46.702605 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f60d25-6f66-4dee-8e21-d5d29225da15 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:46.702884 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f60d25-6f66-4dee-8e21-d5d29225da15 None admin] PATH_INFO: `/v3/users` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:46.703636 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f60d25-6f66-4dee-8e21-d5d29225da15 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:46.703934 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f60d25-6f66-4dee-8e21-d5d29225da15 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:46.705362 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f60d25-6f66-4dee-8e21-d5d29225da15 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:46.724553 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 568/1102] 10.222.0.15 () {56 vars in 1133 bytes} [Sun Sep 18 00:44:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:46.730352 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d047d-bfde-4cbd-bb9d-ed1d775805fa None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:46.796053 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f60d25-6f66-4dee-8e21-d5d29225da15 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:46.823616 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:46.836558 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d047d-bfde-4cbd-bb9d-ed1d775805fa None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:46.878507 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a25c8cc-ecf3-42fd-a5b4-29849efefb8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:46.879413 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25c8cc-ecf3-42fd-a5b4-29849efefb8d None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:46.879834 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25c8cc-ecf3-42fd-a5b4-29849efefb8d None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:46.880359 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25c8cc-ecf3-42fd-a5b4-29849efefb8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:46.903601 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f60d25-6f66-4dee-8e21-d5d29225da15 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:46.941949 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3254c3bc-373a-4309-a1ea-2ef461679d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:46.942905 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3254c3bc-373a-4309-a1ea-2ef461679d0f None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:46.943185 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3254c3bc-373a-4309-a1ea-2ef461679d0f None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:46.943470 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3254c3bc-373a-4309-a1ea-2ef461679d0f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:46.945014 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3254c3bc-373a-4309-a1ea-2ef461679d0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:46.947656 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3254c3bc-373a-4309-a1ea-2ef461679d0f None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:46.949636 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 569/1103] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:44:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:46.956051 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3254c3bc-373a-4309-a1ea-2ef461679d0f None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:46.968515 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a25c8cc-ecf3-42fd-a5b4-29849efefb8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:46.970021 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a25c8cc-ecf3-42fd-a5b4-29849efefb8d None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:46.983709 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:47.063370 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3254c3bc-373a-4309-a1ea-2ef461679d0f None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:47.063752 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:47.084957 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 535/1104] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Sep 18 00:44:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 18 00:44:47.091245 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a25c8cc-ecf3-42fd-a5b4-29849efefb8d None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:47.104641 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea160445-a6fe-4565-92c7-68b90aba63a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:47.105343 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea160445-a6fe-4565-92c7-68b90aba63a4 None admin] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:47.105830 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea160445-a6fe-4565-92c7-68b90aba63a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:47.106322 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea160445-a6fe-4565-92c7-68b90aba63a4 None admin] PATH_INFO: `/v3/users` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:47.107627 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea160445-a6fe-4565-92c7-68b90aba63a4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:47.110307 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea160445-a6fe-4565-92c7-68b90aba63a4 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:47.134638 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 570/1105] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Sep 18 00:44:46 2022] POST /identity/v3/users => generated 286 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 00:44:47.253099 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a25c8cc-ecf3-42fd-a5b4-29849efefb8d None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:47.296275 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8202015f-be63-48f2-b8b4-89695e504882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:47.296945 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8202015f-be63-48f2-b8b4-89695e504882 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:47.297230 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8202015f-be63-48f2-b8b4-89695e504882 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:47.297504 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8202015f-be63-48f2-b8b4-89695e504882 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:47.310376 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8202015f-be63-48f2-b8b4-89695e504882 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:47.312718 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8202015f-be63-48f2-b8b4-89695e504882 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:47.330720 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-8202015f-be63-48f2-b8b4-89695e504882 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:44:47.330720 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:47.330720 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:44:47.330720 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:44:47.330720 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:44:47.330720 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:44:47.330720 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:44:47.330720 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:44:47.330720 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:44:47.330720 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:44:47.330720 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:44:47.330720 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:44:47.330720 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:44:47.330720 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:44:47.330720 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:44:47.330720 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:44:47.331962 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:44:47.331962 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:44:47.331962 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:44:47.331962 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:44:47.331962 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:44:47.331962 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:44:47.331962 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:44:47.331962 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:44:47.331962 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:44:47.331962 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:44:47.331962 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:44:47.331962 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:44:47.331962 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:44:47.331962 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:44:47.331962 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:44:47.331962 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:44:47.331962 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:44:47.333032 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:44:47.333032 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:44:47.333032 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:44:47.333032 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 536/1106] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:44:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:44:47.337833 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea160445-a6fe-4565-92c7-68b90aba63a4 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:47.464867 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:47.508735 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea160445-a6fe-4565-92c7-68b90aba63a4 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:47.546457 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9715b-dde0-4ffe-b09e-212743ed0d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:47.547089 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9715b-dde0-4ffe-b09e-212743ed0d4a None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:47.547370 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9715b-dde0-4ffe-b09e-212743ed0d4a None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:47.547649 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9715b-dde0-4ffe-b09e-212743ed0d4a None admin] PATH_INFO: `/v3/domains` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:47.548341 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a9715b-dde0-4ffe-b09e-212743ed0d4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:47.548653 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a9715b-dde0-4ffe-b09e-212743ed0d4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:47.550033 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a9715b-dde0-4ffe-b09e-212743ed0d4a None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:47.563476 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 571/1107] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:44:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:47.569393 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8202015f-be63-48f2-b8b4-89695e504882 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:47.632898 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:47.704128 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8202015f-be63-48f2-b8b4-89695e504882 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:47.742379 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e395de-a837-41f4-a291-f10d63ae2bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:47.743010 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e395de-a837-41f4-a291-f10d63ae2bc8 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:47.743287 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e395de-a837-41f4-a291-f10d63ae2bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:47.743558 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e395de-a837-41f4-a291-f10d63ae2bc8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:47.751410 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e395de-a837-41f4-a291-f10d63ae2bc8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:47.752896 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e395de-a837-41f4-a291-f10d63ae2bc8 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:47.764900 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-b7e395de-a837-41f4-a291-f10d63ae2bc8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:44:47.764900 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:44:47.764900 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:44:47.764900 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:44:47.764900 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:44:47.764900 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:44:47.764900 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:44:47.764900 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:44:47.764900 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:44:47.764900 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:44:47.764900 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:44:47.764900 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:44:47.764900 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 00:44:47.764900 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 00:44:47.764900 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 00:44:47.765809 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 00:44:47.765809 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:44:47.765809 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:44:47.765809 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:44:47.765809 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:44:47.765809 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:44:47.765809 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:44:47.765809 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:44:47.765809 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:44:47.765809 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:44:47.765809 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:44:47.765809 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:44:47.765809 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:44:47.765809 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:44:47.765809 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:44:47.765809 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:44:47.765809 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:44:47.766730 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 00:44:47.766730 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 00:44:47.766730 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 00:44:47.766730 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 00:44:47.766730 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 00:44:47.766730 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 00:44:47.766730 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:44:47.766730 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:44:47.766730 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 537/1108] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Sep 18 00:44:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:44:47.772475 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9715b-dde0-4ffe-b09e-212743ed0d4a None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:47.907173 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9715b-dde0-4ffe-b09e-212743ed0d4a None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:47.946654 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06516d6d-59ac-4e1a-85d1-60f0aebc2abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:47.947289 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06516d6d-59ac-4e1a-85d1-60f0aebc2abb None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:47.947562 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06516d6d-59ac-4e1a-85d1-60f0aebc2abb None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:47.947832 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06516d6d-59ac-4e1a-85d1-60f0aebc2abb None admin] PATH_INFO: `/v3/projects` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:47.948577 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06516d6d-59ac-4e1a-85d1-60f0aebc2abb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:47.948881 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06516d6d-59ac-4e1a-85d1-60f0aebc2abb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:47.950333 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06516d6d-59ac-4e1a-85d1-60f0aebc2abb None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:47.960386 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:47.964629 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 572/1109] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Sep 18 00:44:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:47.971093 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e395de-a837-41f4-a291-f10d63ae2bc8 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:48.083344 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:48.086883 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e395de-a837-41f4-a291-f10d63ae2bc8 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:48.125924 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e85b766-f4a1-4c8c-bbd4-fb31ec39ccc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:48.126535 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e85b766-f4a1-4c8c-bbd4-fb31ec39ccc1 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:48.126813 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e85b766-f4a1-4c8c-bbd4-fb31ec39ccc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:48.127081 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e85b766-f4a1-4c8c-bbd4-fb31ec39ccc1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:48.127802 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e85b766-f4a1-4c8c-bbd4-fb31ec39ccc1 None admin] RBAC: Adding query filter params (role.id=5e489759b2bc48d6b3895ed9d1f79f19, scope.project.id=52ebde8fa3f84ede9ef575f7c0780798, user.id=264c183fff8a49478eea4aceea73273e) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:48.128132 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e85b766-f4a1-4c8c-bbd4-fb31ec39ccc1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:48.129570 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e85b766-f4a1-4c8c-bbd4-fb31ec39ccc1 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:48.136020 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 538/1110] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Sep 18 00:44:47 2022] GET /identity/v3/role_assignments?user.id=264c183fff8a49478eea4aceea73273e&scope.project.id=52ebde8fa3f84ede9ef575f7c0780798&role.id=5e489759b2bc48d6b3895ed9d1f79f19 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:44:49.581954 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6d69c-a983-4266-aebc-b00ed92f2c7a None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:49.582520 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6d69c-a983-4266-aebc-b00ed92f2c7a None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:49.582520 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6d69c-a983-4266-aebc-b00ed92f2c7a None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:49.583869 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 573/1111] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:44:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:44:49.589306 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af44e0-5664-4e56-9ee3-866991f17cc7 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:49.589721 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af44e0-5664-4e56-9ee3-866991f17cc7 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:49.589922 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af44e0-5664-4e56-9ee3-866991f17cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:49.607733 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-83af44e0-5664-4e56-9ee3-866991f17cc7 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:44:49.608963 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-83af44e0-5664-4e56-9ee3-866991f17cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:44:49.696347 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 539/1112] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:44:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 00:44:49.966533 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab6d69c-a983-4266-aebc-b00ed92f2c7a None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:50.093382 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab6d69c-a983-4266-aebc-b00ed92f2c7a None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:50.130175 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f5e31-2646-4485-a1ff-f952adaeb46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:50.130833 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f5e31-2646-4485-a1ff-f952adaeb46d None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:50.131111 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f5e31-2646-4485-a1ff-f952adaeb46d None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:50.131383 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f5e31-2646-4485-a1ff-f952adaeb46d None admin] PATH_INFO: `/v3/roles/e2a7bd363c424c5380514254ad1cc522` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:50.132894 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9f5e31-2646-4485-a1ff-f952adaeb46d None admin] RBAC: Authorizing `identity:get_role(role_id=e2a7bd363c424c5380514254ad1cc522)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:50.134297 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9f5e31-2646-4485-a1ff-f952adaeb46d None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:50.135697 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 574/1113] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Sep 18 00:44:49 2022] GET /identity/v3/roles/e2a7bd363c424c5380514254ad1cc522 => generated 223 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:50.141832 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af44e0-5664-4e56-9ee3-866991f17cc7 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:50.253047 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:50.261059 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af44e0-5664-4e56-9ee3-866991f17cc7 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:50.306990 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4036b01e-d8cb-4a61-8746-8e8febff1607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:50.307635 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4036b01e-d8cb-4a61-8746-8e8febff1607 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:50.307944 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4036b01e-d8cb-4a61-8746-8e8febff1607 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:50.308218 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4036b01e-d8cb-4a61-8746-8e8febff1607 None admin] PATH_INFO: `/v3/users/af6c6eccfd7a4005b83ffe2ee395a083` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:50.332071 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4036b01e-d8cb-4a61-8746-8e8febff1607 None admin] RBAC: Authorizing `identity:get_user(user_id=af6c6eccfd7a4005b83ffe2ee395a083)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:50.333533 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4036b01e-d8cb-4a61-8746-8e8febff1607 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:50.335224 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 540/1114] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Sep 18 00:44:50 2022] GET /identity/v3/users/af6c6eccfd7a4005b83ffe2ee395a083 => generated 286 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:50.342819 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f5e31-2646-4485-a1ff-f952adaeb46d None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:50.408703 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:50.442464 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f5e31-2646-4485-a1ff-f952adaeb46d None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:50.475305 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053150d4-83ee-4172-87a1-2f06f916e735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:50.475937 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053150d4-83ee-4172-87a1-2f06f916e735 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:50.476221 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053150d4-83ee-4172-87a1-2f06f916e735 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:50.476492 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053150d4-83ee-4172-87a1-2f06f916e735 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:50.544776 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053150d4-83ee-4172-87a1-2f06f916e735 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:50.546683 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053150d4-83ee-4172-87a1-2f06f916e735 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:50.613620 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:50.648553 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 575/1115] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Sep 18 00:44:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 18 00:44:50.655107 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4036b01e-d8cb-4a61-8746-8e8febff1607 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:50.753880 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4036b01e-d8cb-4a61-8746-8e8febff1607 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:50.788122 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32918b6e-c3f8-4b84-b070-852bd333cbbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:50.788755 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32918b6e-c3f8-4b84-b070-852bd333cbbd None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:50.789039 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32918b6e-c3f8-4b84-b070-852bd333cbbd None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:50.789314 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32918b6e-c3f8-4b84-b070-852bd333cbbd None admin] PATH_INFO: `/v3/projects/950f1f754e7b45f8981f323d44fc0803` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:50.790667 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32918b6e-c3f8-4b84-b070-852bd333cbbd None admin] RBAC: Authorizing `identity:get_project(project_id=950f1f754e7b45f8981f323d44fc0803)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:50.792131 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32918b6e-c3f8-4b84-b070-852bd333cbbd None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:50.793745 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 541/1116] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Sep 18 00:44:50 2022] GET /identity/v3/projects/950f1f754e7b45f8981f323d44fc0803 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:50.800097 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053150d4-83ee-4172-87a1-2f06f916e735 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:50.900566 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053150d4-83ee-4172-87a1-2f06f916e735 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:50.934806 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f88c2-d165-4165-8e5a-66b792b16eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:50.935430 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f88c2-d165-4165-8e5a-66b792b16eec None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:50.936230 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f88c2-d165-4165-8e5a-66b792b16eec None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:50.936503 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f88c2-d165-4165-8e5a-66b792b16eec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:50.937230 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0f88c2-d165-4165-8e5a-66b792b16eec None admin] RBAC: Adding query filter params (role.id=e2a7bd363c424c5380514254ad1cc522, scope.project.id=950f1f754e7b45f8981f323d44fc0803, user.id=af6c6eccfd7a4005b83ffe2ee395a083) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:50.937533 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0f88c2-d165-4165-8e5a-66b792b16eec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:50.938994 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0f88c2-d165-4165-8e5a-66b792b16eec None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:50.944547 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 576/1117] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Sep 18 00:44:50 2022] GET /identity/v3/role_assignments?user.id=af6c6eccfd7a4005b83ffe2ee395a083&scope.project.id=950f1f754e7b45f8981f323d44fc0803&role.id=e2a7bd363c424c5380514254ad1cc522 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:53.098534 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ee460-e857-493c-8f13-18b7aec26438 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:53.099138 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ee460-e857-493c-8f13-18b7aec26438 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:53.099138 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ee460-e857-493c-8f13-18b7aec26438 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:53.100459 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 542/1118] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:44:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:44:53.106074 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ee1e1-201d-466f-8b79-9bf479c6ed44 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:53.106554 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ee1e1-201d-466f-8b79-9bf479c6ed44 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:53.106674 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ee1e1-201d-466f-8b79-9bf479c6ed44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:53.126131 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-ac3ee1e1-201d-466f-8b79-9bf479c6ed44 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:44:53.127365 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-ac3ee1e1-201d-466f-8b79-9bf479c6ed44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:44:53.155424 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:53.197357 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 577/1119] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:44:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 00:44:53.471381 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ee460-e857-493c-8f13-18b7aec26438 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:53.493012 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:53.575354 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ee460-e857-493c-8f13-18b7aec26438 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:53.608123 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e405e-ae25-44fd-ae23-947f6a1fa3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:53.608750 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e405e-ae25-44fd-ae23-947f6a1fa3ac None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:53.609029 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e405e-ae25-44fd-ae23-947f6a1fa3ac None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:53.609298 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e405e-ae25-44fd-ae23-947f6a1fa3ac None admin] PATH_INFO: `/v3/roles/e2a7bd363c424c5380514254ad1cc522` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:53.610655 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562e405e-ae25-44fd-ae23-947f6a1fa3ac None admin] RBAC: Authorizing `identity:get_role(role_id=e2a7bd363c424c5380514254ad1cc522)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:53.612053 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562e405e-ae25-44fd-ae23-947f6a1fa3ac None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:53.613366 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 543/1120] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Sep 18 00:44:53 2022] GET /identity/v3/roles/e2a7bd363c424c5380514254ad1cc522 => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:53.619235 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ee1e1-201d-466f-8b79-9bf479c6ed44 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:53.716069 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ee1e1-201d-466f-8b79-9bf479c6ed44 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:53.749619 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8098d60-f054-49d5-9f1b-87396e1fb440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:53.750187 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8098d60-f054-49d5-9f1b-87396e1fb440 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:53.750474 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8098d60-f054-49d5-9f1b-87396e1fb440 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:53.750748 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8098d60-f054-49d5-9f1b-87396e1fb440 None admin] PATH_INFO: `/v3/users/af6c6eccfd7a4005b83ffe2ee395a083` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:53.752034 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8098d60-f054-49d5-9f1b-87396e1fb440 None admin] RBAC: Authorizing `identity:get_user(user_id=af6c6eccfd7a4005b83ffe2ee395a083)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:53.753478 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8098d60-f054-49d5-9f1b-87396e1fb440 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:53.755092 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 578/1121] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Sep 18 00:44:53 2022] GET /identity/v3/users/af6c6eccfd7a4005b83ffe2ee395a083 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:53.760972 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e405e-ae25-44fd-ae23-947f6a1fa3ac None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:53.847081 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:53.859315 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e405e-ae25-44fd-ae23-947f6a1fa3ac None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:53.894286 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2536ecd0-bca0-47e3-946f-4be32136d230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:53.894916 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536ecd0-bca0-47e3-946f-4be32136d230 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:53.895200 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536ecd0-bca0-47e3-946f-4be32136d230 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:53.895478 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536ecd0-bca0-47e3-946f-4be32136d230 None admin] PATH_INFO: `/v3/projects/950f1f754e7b45f8981f323d44fc0803` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:53.896604 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2536ecd0-bca0-47e3-946f-4be32136d230 None admin] RBAC: Authorizing `identity:get_project(project_id=950f1f754e7b45f8981f323d44fc0803)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:53.898041 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2536ecd0-bca0-47e3-946f-4be32136d230 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:53.899666 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 544/1122] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Sep 18 00:44:53 2022] GET /identity/v3/projects/950f1f754e7b45f8981f323d44fc0803 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:53.905759 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8098d60-f054-49d5-9f1b-87396e1fb440 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:53.938260 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:54.007942 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8098d60-f054-49d5-9f1b-87396e1fb440 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:54.040067 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56917593-49a2-4140-a7fe-4a3be55f30c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:54.040982 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56917593-49a2-4140-a7fe-4a3be55f30c6 None admin] REQUEST_METHOD: `PUT` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:54.041265 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56917593-49a2-4140-a7fe-4a3be55f30c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:54.041540 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56917593-49a2-4140-a7fe-4a3be55f30c6 None admin] PATH_INFO: `/v3/projects/950f1f754e7b45f8981f323d44fc0803/users/af6c6eccfd7a4005b83ffe2ee395a083/roles/e2a7bd363c424c5380514254ad1cc522` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:54.043660 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56917593-49a2-4140-a7fe-4a3be55f30c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=950f1f754e7b45f8981f323d44fc0803, user_id=af6c6eccfd7a4005b83ffe2ee395a083, role_id=e2a7bd363c424c5380514254ad1cc522)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:54.045645 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56917593-49a2-4140-a7fe-4a3be55f30c6 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:54.057653 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 579/1123] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Sep 18 00:44:53 2022] PUT /identity/v3/projects/950f1f754e7b45f8981f323d44fc0803/users/af6c6eccfd7a4005b83ffe2ee395a083/roles/e2a7bd363c424c5380514254ad1cc522 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 00:44:56.214206 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d5838-e509-4dfb-a94d-c54fd1261501 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:56.214741 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d5838-e509-4dfb-a94d-c54fd1261501 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:56.214855 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d5838-e509-4dfb-a94d-c54fd1261501 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:56.216131 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 545/1124] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:44:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:44:56.222074 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6027179-866d-41de-9a3b-e830f66a4511 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:56.222538 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6027179-866d-41de-9a3b-e830f66a4511 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:56.222638 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6027179-866d-41de-9a3b-e830f66a4511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:56.241246 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-d6027179-866d-41de-9a3b-e830f66a4511 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:44:56.242454 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-d6027179-866d-41de-9a3b-e830f66a4511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:44:56.308214 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 580/1125] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:44:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 00:44:56.574504 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d5838-e509-4dfb-a94d-c54fd1261501 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:56.682910 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d5838-e509-4dfb-a94d-c54fd1261501 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:56.717970 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7ecb6a-cd42-4a14-aa2a-dc0635cb066f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:56.718600 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ecb6a-cd42-4a14-aa2a-dc0635cb066f None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:56.718878 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ecb6a-cd42-4a14-aa2a-dc0635cb066f None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:56.719147 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ecb6a-cd42-4a14-aa2a-dc0635cb066f None admin] PATH_INFO: `/v3/roles/e2a7bd363c424c5380514254ad1cc522` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:56.720533 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7ecb6a-cd42-4a14-aa2a-dc0635cb066f None admin] RBAC: Authorizing `identity:get_role(role_id=e2a7bd363c424c5380514254ad1cc522)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:56.721910 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7ecb6a-cd42-4a14-aa2a-dc0635cb066f None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:56.723269 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 546/1126] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Sep 18 00:44:56 2022] GET /identity/v3/roles/e2a7bd363c424c5380514254ad1cc522 => generated 223 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:56.729148 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6027179-866d-41de-9a3b-e830f66a4511 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:56.749898 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:56.827559 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6027179-866d-41de-9a3b-e830f66a4511 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:56.860827 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d73aa5-1bed-4fba-ab72-16c5ef2689d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:56.861453 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d73aa5-1bed-4fba-ab72-16c5ef2689d4 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:56.861730 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d73aa5-1bed-4fba-ab72-16c5ef2689d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:56.862003 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d73aa5-1bed-4fba-ab72-16c5ef2689d4 None admin] PATH_INFO: `/v3/users/af6c6eccfd7a4005b83ffe2ee395a083` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:56.863103 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d73aa5-1bed-4fba-ab72-16c5ef2689d4 None admin] RBAC: Authorizing `identity:get_user(user_id=af6c6eccfd7a4005b83ffe2ee395a083)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:56.864552 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d73aa5-1bed-4fba-ab72-16c5ef2689d4 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:56.866126 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 581/1127] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Sep 18 00:44:56 2022] GET /identity/v3/users/af6c6eccfd7a4005b83ffe2ee395a083 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:56.871886 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7ecb6a-cd42-4a14-aa2a-dc0635cb066f None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:56.896375 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:56.970675 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7ecb6a-cd42-4a14-aa2a-dc0635cb066f None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:57.004447 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1d3195-5767-454d-bcec-257da677e4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:57.004970 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d3195-5767-454d-bcec-257da677e4e6 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:57.005250 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d3195-5767-454d-bcec-257da677e4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:57.005525 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d3195-5767-454d-bcec-257da677e4e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:57.070808 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1d3195-5767-454d-bcec-257da677e4e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:57.072288 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1d3195-5767-454d-bcec-257da677e4e6 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:57.096712 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:57.170298 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 547/1128] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Sep 18 00:44:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 18 00:44:57.176291 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d73aa5-1bed-4fba-ab72-16c5ef2689d4 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:57.260799 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:57.272854 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d73aa5-1bed-4fba-ab72-16c5ef2689d4 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:57.305915 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ca3f04-f014-4204-bb0c-3864c2cad6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:57.306538 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca3f04-f014-4204-bb0c-3864c2cad6b8 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:57.306815 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca3f04-f014-4204-bb0c-3864c2cad6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:57.307086 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca3f04-f014-4204-bb0c-3864c2cad6b8 None admin] PATH_INFO: `/v3/projects/950f1f754e7b45f8981f323d44fc0803` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:57.308201 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ca3f04-f014-4204-bb0c-3864c2cad6b8 None admin] RBAC: Authorizing `identity:get_project(project_id=950f1f754e7b45f8981f323d44fc0803)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:57.309625 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ca3f04-f014-4204-bb0c-3864c2cad6b8 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:57.311278 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 582/1129] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Sep 18 00:44:57 2022] GET /identity/v3/projects/950f1f754e7b45f8981f323d44fc0803 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:57.317575 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1d3195-5767-454d-bcec-257da677e4e6 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:44:57.420358 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1d3195-5767-454d-bcec-257da677e4e6 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:44:57.443261 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:44:57.454218 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc981cf7-a173-4983-88b2-4bdb06fab897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:44:57.454821 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc981cf7-a173-4983-88b2-4bdb06fab897 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:57.455103 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc981cf7-a173-4983-88b2-4bdb06fab897 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:57.455383 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc981cf7-a173-4983-88b2-4bdb06fab897 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:57.456128 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc981cf7-a173-4983-88b2-4bdb06fab897 None admin] RBAC: Adding query filter params (role.id=e2a7bd363c424c5380514254ad1cc522, scope.project.id=950f1f754e7b45f8981f323d44fc0803, user.id=af6c6eccfd7a4005b83ffe2ee395a083) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:44:57.456438 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc981cf7-a173-4983-88b2-4bdb06fab897 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:44:57.457872 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc981cf7-a173-4983-88b2-4bdb06fab897 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:44:57.463414 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 548/1130] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Sep 18 00:44:57 2022] GET /identity/v3/role_assignments?user.id=af6c6eccfd7a4005b83ffe2ee395a083&scope.project.id=950f1f754e7b45f8981f323d44fc0803&role.id=e2a7bd363c424c5380514254ad1cc522 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:44:59.622617 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa437ed-f09d-4539-a599-b116b3b3dccc None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:59.623173 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa437ed-f09d-4539-a599-b116b3b3dccc None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:59.623292 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa437ed-f09d-4539-a599-b116b3b3dccc None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:59.624845 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 583/1131] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:44:59.630771 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14edd29-c3f6-41b2-bb86-9904df5d96c2 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:44:59.631358 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14edd29-c3f6-41b2-bb86-9904df5d96c2 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:44:59.631358 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14edd29-c3f6-41b2-bb86-9904df5d96c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:44:59.650494 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-e14edd29-c3f6-41b2-bb86-9904df5d96c2 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:44:59.651715 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-e14edd29-c3f6-41b2-bb86-9904df5d96c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:44:59.723669 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 549/1132] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:44:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 00:44:59.991446 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa437ed-f09d-4539-a599-b116b3b3dccc None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:45:00.097849 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa437ed-f09d-4539-a599-b116b3b3dccc None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:45:00.132538 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c78c67b-4b5f-4073-9fbb-d6fa9ba88769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:45:00.133173 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78c67b-4b5f-4073-9fbb-d6fa9ba88769 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:45:00.133457 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78c67b-4b5f-4073-9fbb-d6fa9ba88769 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:45:00.133735 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78c67b-4b5f-4073-9fbb-d6fa9ba88769 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:45:00.134846 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c78c67b-4b5f-4073-9fbb-d6fa9ba88769 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:45:00.136304 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c78c67b-4b5f-4073-9fbb-d6fa9ba88769 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:45:00.137887 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 584/1133] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:44:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:45:00.144346 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14edd29-c3f6-41b2-bb86-9904df5d96c2 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:45:00.241098 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14edd29-c3f6-41b2-bb86-9904df5d96c2 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:45:00.258729 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:45:00.275454 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d1d3b-998c-4473-bb7d-6d198cd2014e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:45:00.276088 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d1d3b-998c-4473-bb7d-6d198cd2014e None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:45:00.276372 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d1d3b-998c-4473-bb7d-6d198cd2014e None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:45:00.276646 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d1d3b-998c-4473-bb7d-6d198cd2014e None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:45:00.277288 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96d1d3b-998c-4473-bb7d-6d198cd2014e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:45:00.278733 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96d1d3b-998c-4473-bb7d-6d198cd2014e None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:45:00.305585 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 550/1134] 10.222.0.15 () {60 vars in 1141 bytes} [Sun Sep 18 00:45:00 2022] POST /identity/v3/projects => generated 311 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 00:45:02.572431 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794af5cd-5560-48e7-b17e-0cab299c338c None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:45:02.572990 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794af5cd-5560-48e7-b17e-0cab299c338c None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:45:02.572990 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794af5cd-5560-48e7-b17e-0cab299c338c None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:45:02.574328 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 585/1135] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:45:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:45:02.580505 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75712bf3-2b50-483a-bd88-b33ab76218fb None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:45:02.580938 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75712bf3-2b50-483a-bd88-b33ab76218fb None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:45:02.581047 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75712bf3-2b50-483a-bd88-b33ab76218fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:45:02.599875 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-75712bf3-2b50-483a-bd88-b33ab76218fb None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:45:02.601108 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-75712bf3-2b50-483a-bd88-b33ab76218fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:45:02.668515 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 551/1136] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:45:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 00:45:02.939790 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794af5cd-5560-48e7-b17e-0cab299c338c None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:45:02.966571 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:45:03.048212 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794af5cd-5560-48e7-b17e-0cab299c338c None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:45:03.085329 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3324a8-b3fc-475a-a020-ced459c6735d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:45:03.085976 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3324a8-b3fc-475a-a020-ced459c6735d None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:45:03.086254 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3324a8-b3fc-475a-a020-ced459c6735d None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:45:03.086526 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3324a8-b3fc-475a-a020-ced459c6735d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:45:03.087686 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3324a8-b3fc-475a-a020-ced459c6735d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:45:03.089179 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3324a8-b3fc-475a-a020-ced459c6735d None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:45:03.090844 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 586/1137] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:45:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:45:03.096735 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75712bf3-2b50-483a-bd88-b33ab76218fb None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:45:03.195596 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:45:03.198460 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75712bf3-2b50-483a-bd88-b33ab76218fb None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:45:03.236372 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d7230b-7dc4-4f5e-9b08-995f30de68bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:45:03.236984 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7230b-7dc4-4f5e-9b08-995f30de68bf None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:45:03.237263 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7230b-7dc4-4f5e-9b08-995f30de68bf None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:45:03.237534 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7230b-7dc4-4f5e-9b08-995f30de68bf None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:45:03.238193 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d7230b-7dc4-4f5e-9b08-995f30de68bf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:45:03.239623 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d7230b-7dc4-4f5e-9b08-995f30de68bf None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:45:03.261516 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 552/1138] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Sep 18 00:45:03 2022] POST /identity/v3/users => generated 286 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 00:45:05.487858 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dec902-3c07-4b27-a3c1-61f40642f5ab None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:45:05.488359 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dec902-3c07-4b27-a3c1-61f40642f5ab None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:45:05.488448 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dec902-3c07-4b27-a3c1-61f40642f5ab None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:45:05.489760 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 587/1139] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:45:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:45:05.494899 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b29c5-88cd-4f89-95e0-9161990f5f75 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:45:05.495295 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b29c5-88cd-4f89-95e0-9161990f5f75 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:45:05.495451 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b29c5-88cd-4f89-95e0-9161990f5f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:45:05.514082 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-3c0b29c5-88cd-4f89-95e0-9161990f5f75 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:45:05.515284 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-3c0b29c5-88cd-4f89-95e0-9161990f5f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:45:05.583499 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 553/1140] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:45:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 00:45:05.849644 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dec902-3c07-4b27-a3c1-61f40642f5ab None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:45:05.946661 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:45:05.960018 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dec902-3c07-4b27-a3c1-61f40642f5ab None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:45:05.997503 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a502d799-0660-4543-b1f8-d4d720c22145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:45:05.998155 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502d799-0660-4543-b1f8-d4d720c22145 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:45:05.998435 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502d799-0660-4543-b1f8-d4d720c22145 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:45:05.998710 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502d799-0660-4543-b1f8-d4d720c22145 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:45:06.009898 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a502d799-0660-4543-b1f8-d4d720c22145 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:45:06.015378 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-a502d799-0660-4543-b1f8-d4d720c22145 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 00:45:06.015378 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:45:06.015378 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:45:06.015378 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:45:06.015378 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:45:06.015378 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:45:06.015378 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:45:06.015378 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:45:06.015378 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:45:06.015378 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:45:06.015378 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:45:06.015378 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:45:06.015378 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:45:06.015378 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:45:06.015378 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:45:06.015378 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:45:06.016605 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:45:06.016605 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:45:06.016605 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:45:06.016605 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:45:06.016605 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:45:06.016605 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:45:06.016605 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:45:06.016605 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:45:06.016605 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:45:06.016605 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:45:06.016605 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:45:06.016605 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:45:06.016605 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:45:06.016605 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:45:06.016605 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:45:06.016605 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:45:06.017506 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:45:06.017506 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:45:06.017506 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:45:06.017506 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:45:06.017506 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:45:06.017506 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:45:06.017506 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:45:06.017506 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:45:06.017506 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:45:06.017506 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:45:06.017506 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 00:45:06.017506 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:45:06.017506 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 588/1141] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Sep 18 00:45:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:45:06.022856 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b29c5-88cd-4f89-95e0-9161990f5f75 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:45:06.110616 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:45:06.129502 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b29c5-88cd-4f89-95e0-9161990f5f75 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:45:06.163119 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d1de1-d8b7-4e79-ab6c-48871f9952e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:45:06.163733 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d1de1-d8b7-4e79-ab6c-48871f9952e2 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:45:06.164051 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d1de1-d8b7-4e79-ab6c-48871f9952e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:45:06.164331 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d1de1-d8b7-4e79-ab6c-48871f9952e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:45:06.164991 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711d1de1-d8b7-4e79-ab6c-48871f9952e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:45:06.165554 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711d1de1-d8b7-4e79-ab6c-48871f9952e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:45:06.166933 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711d1de1-d8b7-4e79-ab6c-48871f9952e2 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:45:06.175587 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 554/1142] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Sep 18 00:45:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:45:06.181611 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a502d799-0660-4543-b1f8-d4d720c22145 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:45:06.279933 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a502d799-0660-4543-b1f8-d4d720c22145 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:45:06.313984 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768ff8ba-5f7f-4821-8246-d5f85e4df04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:45:06.314620 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ff8ba-5f7f-4821-8246-d5f85e4df04d None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:45:06.314901 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ff8ba-5f7f-4821-8246-d5f85e4df04d None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:45:06.315175 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ff8ba-5f7f-4821-8246-d5f85e4df04d None admin] PATH_INFO: `/v3/users/7e3e5abe80194dd8855fe91bc85a3a40` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:45:06.328284 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768ff8ba-5f7f-4821-8246-d5f85e4df04d None admin] RBAC: Authorizing `identity:get_user(user_id=7e3e5abe80194dd8855fe91bc85a3a40)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:45:06.329726 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768ff8ba-5f7f-4821-8246-d5f85e4df04d None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:45:06.331374 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 589/1143] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Sep 18 00:45:06 2022] GET /identity/v3/users/7e3e5abe80194dd8855fe91bc85a3a40 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:45:06.337220 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d1de1-d8b7-4e79-ab6c-48871f9952e2 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:45:06.436724 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d1de1-d8b7-4e79-ab6c-48871f9952e2 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:45:06.477977 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9eca0a-21d1-4311-ad89-663ec8ab1692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:45:06.478610 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9eca0a-21d1-4311-ad89-663ec8ab1692 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:45:06.478884 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9eca0a-21d1-4311-ad89-663ec8ab1692 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:45:06.479153 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9eca0a-21d1-4311-ad89-663ec8ab1692 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:45:06.498076 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:45:06.550799 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9eca0a-21d1-4311-ad89-663ec8ab1692 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:45:06.552281 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9eca0a-21d1-4311-ad89-663ec8ab1692 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:45:06.647497 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 555/1144] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Sep 18 00:45:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 18 00:45:06.654053 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768ff8ba-5f7f-4821-8246-d5f85e4df04d None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:45:06.666496 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:45:06.752765 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768ff8ba-5f7f-4821-8246-d5f85e4df04d None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:45:06.787567 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f650b5e7-bcce-4e02-b23c-ae7271061f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:45:06.788228 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650b5e7-bcce-4e02-b23c-ae7271061f53 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:45:06.788507 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650b5e7-bcce-4e02-b23c-ae7271061f53 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:45:06.788780 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650b5e7-bcce-4e02-b23c-ae7271061f53 None admin] PATH_INFO: `/v3/projects/6fbc6097b3ff4cc3912ba4956eeff179` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:45:06.789888 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f650b5e7-bcce-4e02-b23c-ae7271061f53 None admin] RBAC: Authorizing `identity:get_project(project_id=6fbc6097b3ff4cc3912ba4956eeff179)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:45:06.791588 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f650b5e7-bcce-4e02-b23c-ae7271061f53 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:45:06.793253 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 590/1145] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Sep 18 00:45:06 2022] GET /identity/v3/projects/6fbc6097b3ff4cc3912ba4956eeff179 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:45:06.799370 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9eca0a-21d1-4311-ad89-663ec8ab1692 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:45:06.849645 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:45:06.899762 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9eca0a-21d1-4311-ad89-663ec8ab1692 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:45:06.933017 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c6db9f-3202-4e35-a58e-674999217cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:45:06.933623 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c6db9f-3202-4e35-a58e-674999217cfd None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:45:06.933901 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c6db9f-3202-4e35-a58e-674999217cfd None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:45:06.934173 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c6db9f-3202-4e35-a58e-674999217cfd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:45:06.935090 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c6db9f-3202-4e35-a58e-674999217cfd None admin] RBAC: Adding query filter params (role.id=591d4711dc204cf98003c8b7d7558506, scope.project.id=6fbc6097b3ff4cc3912ba4956eeff179, user.id=7e3e5abe80194dd8855fe91bc85a3a40) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:45:06.935401 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c6db9f-3202-4e35-a58e-674999217cfd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:45:06.936859 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c6db9f-3202-4e35-a58e-674999217cfd None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:45:06.942066 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 556/1146] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Sep 18 00:45:06 2022] GET /identity/v3/role_assignments?user.id=7e3e5abe80194dd8855fe91bc85a3a40&scope.project.id=6fbc6097b3ff4cc3912ba4956eeff179&role.id=591d4711dc204cf98003c8b7d7558506 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:45:09.088756 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e662f99-ca16-465a-8348-924b6636c506 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:45:09.089293 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e662f99-ca16-465a-8348-924b6636c506 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:45:09.089293 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e662f99-ca16-465a-8348-924b6636c506 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:45:09.090652 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 591/1147] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:45:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:45:09.096623 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1d209-b698-4c33-ad39-d9a787a0d882 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:45:09.097023 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1d209-b698-4c33-ad39-d9a787a0d882 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:45:09.097191 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1d209-b698-4c33-ad39-d9a787a0d882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:45:09.115418 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-ccc1d209-b698-4c33-ad39-d9a787a0d882 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:45:09.116675 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-ccc1d209-b698-4c33-ad39-d9a787a0d882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:45:09.182693 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 557/1148] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:45:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 00:45:09.453707 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e662f99-ca16-465a-8348-924b6636c506 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:45:09.535116 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:45:09.557976 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e662f99-ca16-465a-8348-924b6636c506 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:45:09.590323 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326effb7-5a2c-4008-97f3-cb13b3181389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:45:09.591441 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326effb7-5a2c-4008-97f3-cb13b3181389 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:45:09.591718 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326effb7-5a2c-4008-97f3-cb13b3181389 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:45:09.592017 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326effb7-5a2c-4008-97f3-cb13b3181389 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:45:09.601733 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326effb7-5a2c-4008-97f3-cb13b3181389 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:45:09.607044 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-326effb7-5a2c-4008-97f3-cb13b3181389 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 00:45:09.607044 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:45:09.607044 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:45:09.607044 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:45:09.607044 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:45:09.607044 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:45:09.607044 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:45:09.607044 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:45:09.607044 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:45:09.607044 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:45:09.607044 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:45:09.607044 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:45:09.607044 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:45:09.607044 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:45:09.607044 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:45:09.607044 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:45:09.608109 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:45:09.608109 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:45:09.608109 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:45:09.608109 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:45:09.608109 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:45:09.608109 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:45:09.608109 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:45:09.608109 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:45:09.608109 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:45:09.608109 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:45:09.608109 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:45:09.608109 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:45:09.608109 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:45:09.608109 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:45:09.608109 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:45:09.608109 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:45:09.608956 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:45:09.608956 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:45:09.608956 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:45:09.608956 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:45:09.608956 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:45:09.608956 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:45:09.608956 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:45:09.608956 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:45:09.608956 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:45:09.608956 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:45:09.608956 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 00:45:09.608956 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:45:09.608956 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 592/1149] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Sep 18 00:45:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:45:09.614338 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc1d209-b698-4c33-ad39-d9a787a0d882 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:45:09.660967 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:45:09.720915 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc1d209-b698-4c33-ad39-d9a787a0d882 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:45:09.754111 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ade703f-5db7-492a-96ca-ba47ba3bcbf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:45:09.754718 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade703f-5db7-492a-96ca-ba47ba3bcbf6 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:45:09.755001 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade703f-5db7-492a-96ca-ba47ba3bcbf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:45:09.755274 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade703f-5db7-492a-96ca-ba47ba3bcbf6 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:45:09.755953 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ade703f-5db7-492a-96ca-ba47ba3bcbf6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:45:09.756261 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ade703f-5db7-492a-96ca-ba47ba3bcbf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:45:09.757625 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ade703f-5db7-492a-96ca-ba47ba3bcbf6 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:45:09.765491 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 558/1150] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Sep 18 00:45:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:45:09.771305 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326effb7-5a2c-4008-97f3-cb13b3181389 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:45:09.871253 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326effb7-5a2c-4008-97f3-cb13b3181389 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:45:09.905225 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd3973-5b42-44f4-97d6-ab06761b99a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:45:09.905862 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd3973-5b42-44f4-97d6-ab06761b99a7 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:45:09.906140 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd3973-5b42-44f4-97d6-ab06761b99a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:45:09.906412 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd3973-5b42-44f4-97d6-ab06761b99a7 None admin] PATH_INFO: `/v3/users/7e3e5abe80194dd8855fe91bc85a3a40` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:45:09.907528 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdd3973-5b42-44f4-97d6-ab06761b99a7 None admin] RBAC: Authorizing `identity:get_user(user_id=7e3e5abe80194dd8855fe91bc85a3a40)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:45:09.908983 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdd3973-5b42-44f4-97d6-ab06761b99a7 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:45:09.910564 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 593/1151] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Sep 18 00:45:09 2022] GET /identity/v3/users/7e3e5abe80194dd8855fe91bc85a3a40 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:45:09.916742 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ade703f-5db7-492a-96ca-ba47ba3bcbf6 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:45:10.017918 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ade703f-5db7-492a-96ca-ba47ba3bcbf6 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:45:10.020678 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:45:10.052729 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6032e4-4031-4395-b69f-e2a179322c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:45:10.053369 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6032e4-4031-4395-b69f-e2a179322c2d None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:45:10.053653 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6032e4-4031-4395-b69f-e2a179322c2d None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:45:10.053932 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6032e4-4031-4395-b69f-e2a179322c2d None admin] PATH_INFO: `/v3/projects/6fbc6097b3ff4cc3912ba4956eeff179` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:45:10.055041 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6032e4-4031-4395-b69f-e2a179322c2d None admin] RBAC: Authorizing `identity:get_project(project_id=6fbc6097b3ff4cc3912ba4956eeff179)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:45:10.056524 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6032e4-4031-4395-b69f-e2a179322c2d None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:45:10.058160 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 559/1152] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Sep 18 00:45:09 2022] GET /identity/v3/projects/6fbc6097b3ff4cc3912ba4956eeff179 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:45:10.064240 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd3973-5b42-44f4-97d6-ab06761b99a7 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:45:10.072983 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:45:10.164212 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd3973-5b42-44f4-97d6-ab06761b99a7 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:45:10.209441 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8358f1-4498-4a10-a71c-8296382ec4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:45:10.210059 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8358f1-4498-4a10-a71c-8296382ec4ab None admin] REQUEST_METHOD: `PUT` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:45:10.210351 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8358f1-4498-4a10-a71c-8296382ec4ab None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:45:10.210628 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8358f1-4498-4a10-a71c-8296382ec4ab None admin] PATH_INFO: `/v3/projects/6fbc6097b3ff4cc3912ba4956eeff179/users/7e3e5abe80194dd8855fe91bc85a3a40/roles/591d4711dc204cf98003c8b7d7558506` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:45:10.213040 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8358f1-4498-4a10-a71c-8296382ec4ab None admin] RBAC: Authorizing `identity:create_grant(project_id=6fbc6097b3ff4cc3912ba4956eeff179, user_id=7e3e5abe80194dd8855fe91bc85a3a40, role_id=591d4711dc204cf98003c8b7d7558506)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:45:10.215412 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8358f1-4498-4a10-a71c-8296382ec4ab None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:45:10.230646 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 594/1153] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Sep 18 00:45:10 2022] PUT /identity/v3/projects/6fbc6097b3ff4cc3912ba4956eeff179/users/7e3e5abe80194dd8855fe91bc85a3a40/roles/591d4711dc204cf98003c8b7d7558506 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 00:45:12.361620 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53a41a-8a4f-4dc5-9761-fa7fa1799d7b None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:45:12.362187 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53a41a-8a4f-4dc5-9761-fa7fa1799d7b None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:45:12.362187 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53a41a-8a4f-4dc5-9761-fa7fa1799d7b None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:45:12.363512 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 560/1154] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:45:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:45:12.368763 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4f485-302e-47f3-83d8-6fb62289c924 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:45:12.369231 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4f485-302e-47f3-83d8-6fb62289c924 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:45:12.369338 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4f485-302e-47f3-83d8-6fb62289c924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:45:12.387097 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-64e4f485-302e-47f3-83d8-6fb62289c924 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:45:12.388324 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-64e4f485-302e-47f3-83d8-6fb62289c924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:45:12.451553 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:45:12.460677 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 595/1155] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:45:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 18 00:45:12.730939 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53a41a-8a4f-4dc5-9761-fa7fa1799d7b None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:45:12.832856 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53a41a-8a4f-4dc5-9761-fa7fa1799d7b None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:45:12.865606 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af6cac7-066e-4054-8ee6-1304d0cb2983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:45:12.866229 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6cac7-066e-4054-8ee6-1304d0cb2983 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:45:12.866508 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6cac7-066e-4054-8ee6-1304d0cb2983 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:45:12.866780 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6cac7-066e-4054-8ee6-1304d0cb2983 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:45:12.878140 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af6cac7-066e-4054-8ee6-1304d0cb2983 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:45:12.885793 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-1af6cac7-066e-4054-8ee6-1304d0cb2983 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 00:45:12.885793 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:45:12.885793 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:45:12.885793 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:45:12.885793 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:45:12.885793 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:45:12.885793 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:45:12.885793 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:45:12.885793 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:45:12.885793 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:45:12.885793 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:45:12.885793 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:45:12.885793 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:45:12.885793 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:45:12.885793 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:45:12.885793 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:45:12.886899 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:45:12.886899 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:45:12.886899 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:45:12.886899 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:45:12.886899 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:45:12.886899 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:45:12.886899 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:45:12.886899 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:45:12.886899 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:45:12.886899 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:45:12.886899 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:45:12.886899 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:45:12.886899 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:45:12.886899 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:45:12.886899 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:45:12.886899 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:45:12.887937 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:45:12.887937 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:45:12.887937 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:45:12.887937 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:45:12.887937 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:45:12.887937 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:45:12.887937 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:45:12.887937 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:45:12.887937 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:45:12.887937 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:45:12.887937 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 00:45:12.887937 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:45:12.887937 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 561/1156] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Sep 18 00:45:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:45:12.896117 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4f485-302e-47f3-83d8-6fb62289c924 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:45:12.998350 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4f485-302e-47f3-83d8-6fb62289c924 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:45:13.030280 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c3ba49-aae4-4d6c-a27f-da387c69f020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:45:13.030895 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3ba49-aae4-4d6c-a27f-da387c69f020 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:45:13.031178 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3ba49-aae4-4d6c-a27f-da387c69f020 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:45:13.031452 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3ba49-aae4-4d6c-a27f-da387c69f020 None admin] PATH_INFO: `/v3/roles` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:45:13.032138 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c3ba49-aae4-4d6c-a27f-da387c69f020 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:45:13.032443 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c3ba49-aae4-4d6c-a27f-da387c69f020 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:45:13.033805 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c3ba49-aae4-4d6c-a27f-da387c69f020 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:45:13.042063 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 596/1157] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Sep 18 00:45:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:45:13.048766 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af6cac7-066e-4054-8ee6-1304d0cb2983 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:45:13.080680 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:45:13.149674 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af6cac7-066e-4054-8ee6-1304d0cb2983 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:45:13.182215 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13890b30-cfe3-4517-b4ba-f044cbdd1d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:45:13.182847 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13890b30-cfe3-4517-b4ba-f044cbdd1d55 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:45:13.183131 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13890b30-cfe3-4517-b4ba-f044cbdd1d55 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:45:13.183405 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13890b30-cfe3-4517-b4ba-f044cbdd1d55 None admin] PATH_INFO: `/v3/users/7e3e5abe80194dd8855fe91bc85a3a40` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:45:13.185176 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13890b30-cfe3-4517-b4ba-f044cbdd1d55 None admin] RBAC: Authorizing `identity:get_user(user_id=7e3e5abe80194dd8855fe91bc85a3a40)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:45:13.186705 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13890b30-cfe3-4517-b4ba-f044cbdd1d55 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:45:13.191818 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 562/1158] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Sep 18 00:45:13 2022] GET /identity/v3/users/7e3e5abe80194dd8855fe91bc85a3a40 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:45:13.197667 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c3ba49-aae4-4d6c-a27f-da387c69f020 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:45:13.255979 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:45:13.300086 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c3ba49-aae4-4d6c-a27f-da387c69f020 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:45:13.332010 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a70ebd9-ba13-4cf1-b4b6-832c42e2a570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:45:13.332615 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70ebd9-ba13-4cf1-b4b6-832c42e2a570 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:45:13.332898 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70ebd9-ba13-4cf1-b4b6-832c42e2a570 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:45:13.333173 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70ebd9-ba13-4cf1-b4b6-832c42e2a570 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:45:13.397637 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a70ebd9-ba13-4cf1-b4b6-832c42e2a570 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:45:13.399067 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a70ebd9-ba13-4cf1-b4b6-832c42e2a570 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:45:13.454346 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:45:13.505875 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 597/1159] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Sep 18 00:45:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 18 00:45:13.512128 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13890b30-cfe3-4517-b4ba-f044cbdd1d55 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:45:13.607233 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:45:13.610268 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13890b30-cfe3-4517-b4ba-f044cbdd1d55 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:45:13.643542 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba8a916-75a6-493d-a5d0-36eea62c9df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:45:13.644203 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8a916-75a6-493d-a5d0-36eea62c9df0 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:45:13.644483 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8a916-75a6-493d-a5d0-36eea62c9df0 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:45:13.644754 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8a916-75a6-493d-a5d0-36eea62c9df0 None admin] PATH_INFO: `/v3/projects/6fbc6097b3ff4cc3912ba4956eeff179` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:45:13.645849 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba8a916-75a6-493d-a5d0-36eea62c9df0 None admin] RBAC: Authorizing `identity:get_project(project_id=6fbc6097b3ff4cc3912ba4956eeff179)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:45:13.647284 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba8a916-75a6-493d-a5d0-36eea62c9df0 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:45:13.648920 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 563/1160] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Sep 18 00:45:13 2022] GET /identity/v3/projects/6fbc6097b3ff4cc3912ba4956eeff179 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:45:13.655703 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a70ebd9-ba13-4cf1-b4b6-832c42e2a570 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:45:13.751044 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a70ebd9-ba13-4cf1-b4b6-832c42e2a570 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:45:13.783670 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0bc4a6-af47-4f86-bd0d-bc78e1f72ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:45:13.784233 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0bc4a6-af47-4f86-bd0d-bc78e1f72ae2 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:45:13.784515 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0bc4a6-af47-4f86-bd0d-bc78e1f72ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:45:13.784787 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0bc4a6-af47-4f86-bd0d-bc78e1f72ae2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:45:13.785507 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0bc4a6-af47-4f86-bd0d-bc78e1f72ae2 None admin] RBAC: Adding query filter params (role.id=591d4711dc204cf98003c8b7d7558506, scope.project.id=6fbc6097b3ff4cc3912ba4956eeff179, user.id=7e3e5abe80194dd8855fe91bc85a3a40) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:45:13.785817 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0bc4a6-af47-4f86-bd0d-bc78e1f72ae2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:45:13.787228 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0bc4a6-af47-4f86-bd0d-bc78e1f72ae2 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:45:13.793060 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 598/1161] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Sep 18 00:45:13 2022] GET /identity/v3/role_assignments?user.id=7e3e5abe80194dd8855fe91bc85a3a40&scope.project.id=6fbc6097b3ff4cc3912ba4956eeff179&role.id=591d4711dc204cf98003c8b7d7558506 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:45:15.958186 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99517b2a-9d14-4e5f-92a7-25d39ac71d34 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:45:15.958717 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99517b2a-9d14-4e5f-92a7-25d39ac71d34 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:45:15.958717 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99517b2a-9d14-4e5f-92a7-25d39ac71d34 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:45:15.960117 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 564/1162] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:45:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:45:15.965529 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eca0dc-522d-44ca-962a-0195fa9e582f None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:45:15.965946 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eca0dc-522d-44ca-962a-0195fa9e582f None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:45:15.966078 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eca0dc-522d-44ca-962a-0195fa9e582f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:45:15.984653 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-a9eca0dc-522d-44ca-962a-0195fa9e582f None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:45:15.985828 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-a9eca0dc-522d-44ca-962a-0195fa9e582f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:45:16.001915 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:45:16.052522 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 599/1163] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:45:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 00:45:16.323120 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99517b2a-9d14-4e5f-92a7-25d39ac71d34 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:45:16.424092 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99517b2a-9d14-4e5f-92a7-25d39ac71d34 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:45:16.457074 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228fc687-b095-4b61-b89f-3ab65fd2773c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:45:16.457678 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fc687-b095-4b61-b89f-3ab65fd2773c None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:45:16.457953 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fc687-b095-4b61-b89f-3ab65fd2773c None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:45:16.458222 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fc687-b095-4b61-b89f-3ab65fd2773c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:45:16.491251 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:45:16.525771 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228fc687-b095-4b61-b89f-3ab65fd2773c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:45:16.527254 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228fc687-b095-4b61-b89f-3ab65fd2773c None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:45:16.645531 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 565/1164] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Sep 18 00:45:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 18 00:45:16.651435 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eca0dc-522d-44ca-962a-0195fa9e582f None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:45:16.748738 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eca0dc-522d-44ca-962a-0195fa9e582f None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:45:16.781741 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5effef54-0996-453b-bf91-e814f7701dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:45:16.782390 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5effef54-0996-453b-bf91-e814f7701dbb None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:45:16.782667 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5effef54-0996-453b-bf91-e814f7701dbb None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:45:16.782939 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5effef54-0996-453b-bf91-e814f7701dbb None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:45:16.789410 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5effef54-0996-453b-bf91-e814f7701dbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:45:16.791088 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5effef54-0996-453b-bf91-e814f7701dbb None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:45:16.802031 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-5effef54-0996-453b-bf91-e814f7701dbb None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 18 00:45:16.802031 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:45:16.802031 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 18 00:45:16.802031 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 18 00:45:16.802031 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 00:45:16.802031 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 00:45:16.802031 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 00:45:16.802031 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 00:45:16.802031 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 18 00:45:16.802031 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:45:16.802031 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 18 00:45:16.802031 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:45:16.802031 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:45:16.802031 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:45:16.802031 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:45:16.802031 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:45:16.802031 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:45:16.803222 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:45:16.803222 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:45:16.803222 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:45:16.803222 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:45:16.803222 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:45:16.803222 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:45:16.803222 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:45:16.803222 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:45:16.803222 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:45:16.803222 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:45:16.803222 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:45:16.803222 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:45:16.803222 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:45:16.803222 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:45:16.803222 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:45:16.803222 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:45:16.804085 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:45:16.804085 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:45:16.804085 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:45:16.804085 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:45:16.804085 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:45:16.804085 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:45:16.804085 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:45:16.804085 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:45:16.804085 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:45:16.804085 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:45:16.804085 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 18 00:45:16.804085 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:45:16.804085 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 18 00:45:16.804085 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:45:16.804085 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 600/1165] 10.222.0.15 () {56 vars in 1117 bytes} [Sun Sep 18 00:45:16 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:45:16.809169 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228fc687-b095-4b61-b89f-3ab65fd2773c None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:45:16.880504 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:45:16.920918 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228fc687-b095-4b61-b89f-3ab65fd2773c None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:45:16.954992 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd616e32-de3c-4bed-9db9-449d65fd749e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:45:16.955598 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd616e32-de3c-4bed-9db9-449d65fd749e None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:45:16.955878 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd616e32-de3c-4bed-9db9-449d65fd749e None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:45:16.956185 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd616e32-de3c-4bed-9db9-449d65fd749e None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:45:16.956821 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd616e32-de3c-4bed-9db9-449d65fd749e None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:45:16.957123 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd616e32-de3c-4bed-9db9-449d65fd749e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:45:16.958485 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd616e32-de3c-4bed-9db9-449d65fd749e None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:45:16.965722 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 566/1166] 10.222.0.15 () {56 vars in 1115 bytes} [Sun Sep 18 00:45:16 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:45:19.093875 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856a331-d540-47d7-8328-9160d9e65b1a None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:45:19.094562 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856a331-d540-47d7-8328-9160d9e65b1a None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:45:19.094562 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856a331-d540-47d7-8328-9160d9e65b1a None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:45:19.095750 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 601/1167] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:45:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:45:19.101188 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d62dd-858f-41d4-a801-c8325139783e None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:45:19.101614 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d62dd-858f-41d4-a801-c8325139783e None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:45:19.101748 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d62dd-858f-41d4-a801-c8325139783e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:45:19.119915 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-142d62dd-858f-41d4-a801-c8325139783e None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:45:19.121124 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-142d62dd-858f-41d4-a801-c8325139783e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:45:19.188933 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 567/1168] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:45:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 00:45:19.459510 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856a331-d540-47d7-8328-9160d9e65b1a None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:45:19.475128 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:45:19.561892 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856a331-d540-47d7-8328-9160d9e65b1a None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:45:19.596146 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0158cc97-4740-4ed6-9756-ca2b0cc3db6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:45:19.596752 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158cc97-4740-4ed6-9756-ca2b0cc3db6e None admin] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:45:19.597031 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158cc97-4740-4ed6-9756-ca2b0cc3db6e None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:45:19.597306 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158cc97-4740-4ed6-9756-ca2b0cc3db6e None admin] PATH_INFO: `/v3/domains` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:45:19.597974 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0158cc97-4740-4ed6-9756-ca2b0cc3db6e None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:45:19.599322 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0158cc97-4740-4ed6-9756-ca2b0cc3db6e None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:45:19.614840 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 602/1169] 10.222.0.15 () {60 vars in 1138 bytes} [Sun Sep 18 00:45:19 2022] POST /identity/v3/domains => generated 267 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 00:45:21.783466 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c1e657-a6fe-4119-860f-a888f30478b9 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:45:21.784097 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c1e657-a6fe-4119-860f-a888f30478b9 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:45:21.784097 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c1e657-a6fe-4119-860f-a888f30478b9 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:45:21.785305 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 568/1170] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:45:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:45:21.790989 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04146879-1d07-4ad5-9680-d605b0ff24d0 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:45:21.791403 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04146879-1d07-4ad5-9680-d605b0ff24d0 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:45:21.791549 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04146879-1d07-4ad5-9680-d605b0ff24d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:45:21.809634 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-04146879-1d07-4ad5-9680-d605b0ff24d0 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:45:21.810838 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-04146879-1d07-4ad5-9680-d605b0ff24d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:45:21.876913 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 603/1171] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:45:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 00:45:22.148636 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c1e657-a6fe-4119-860f-a888f30478b9 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:45:22.213293 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:45:22.258156 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c1e657-a6fe-4119-860f-a888f30478b9 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:45:22.292225 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac568f1d-7fed-4e98-8e61-9aa4334693b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:45:22.292860 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac568f1d-7fed-4e98-8e61-9aa4334693b4 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:45:22.293164 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac568f1d-7fed-4e98-8e61-9aa4334693b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:45:22.293444 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac568f1d-7fed-4e98-8e61-9aa4334693b4 None admin] PATH_INFO: `/v3/domains/69226181085e4323a381167aef795871` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:45:22.303817 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac568f1d-7fed-4e98-8e61-9aa4334693b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=69226181085e4323a381167aef795871)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:45:22.305285 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac568f1d-7fed-4e98-8e61-9aa4334693b4 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:45:22.306898 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 569/1172] 10.222.0.15 () {56 vars in 1183 bytes} [Sun Sep 18 00:45:22 2022] GET /identity/v3/domains/69226181085e4323a381167aef795871 => generated 267 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:45:22.313350 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04146879-1d07-4ad5-9680-d605b0ff24d0 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:45:22.315546 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:45:22.420185 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04146879-1d07-4ad5-9680-d605b0ff24d0 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:45:22.457018 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e08c2b2-26e3-44ea-9258-95820635846b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:45:22.457645 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08c2b2-26e3-44ea-9258-95820635846b None admin] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:45:22.457926 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08c2b2-26e3-44ea-9258-95820635846b None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:45:22.458199 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08c2b2-26e3-44ea-9258-95820635846b None admin] PATH_INFO: `/v3/projects` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:45:22.458861 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e08c2b2-26e3-44ea-9258-95820635846b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:45:22.460380 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e08c2b2-26e3-44ea-9258-95820635846b None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:45:22.489821 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 604/1173] 10.222.0.15 () {60 vars in 1141 bytes} [Sun Sep 18 00:45:22 2022] POST /identity/v3/projects => generated 361 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 00:45:24.665843 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894f392-99fc-46e0-a4d3-fe4d5ada4be3 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:45:24.666389 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894f392-99fc-46e0-a4d3-fe4d5ada4be3 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:45:24.666389 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894f392-99fc-46e0-a4d3-fe4d5ada4be3 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:45:24.667732 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 570/1174] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:45:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 18 00:45:24.672955 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df63dc0-592d-45b0-a413-52087a18d70e None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:45:24.673346 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df63dc0-592d-45b0-a413-52087a18d70e None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:45:24.673507 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df63dc0-592d-45b0-a413-52087a18d70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:45:24.691765 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-2df63dc0-592d-45b0-a413-52087a18d70e None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:45:24.692963 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-2df63dc0-592d-45b0-a413-52087a18d70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:45:24.740884 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:45:24.759286 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 605/1175] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:45:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 00:45:25.034034 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6894f392-99fc-46e0-a4d3-fe4d5ada4be3 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:45:25.143954 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6894f392-99fc-46e0-a4d3-fe4d5ada4be3 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:45:25.168177 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:45:25.180453 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392939a-da15-410d-996f-1f0e08de1dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:45:25.181091 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392939a-da15-410d-996f-1f0e08de1dbf None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:45:25.181368 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392939a-da15-410d-996f-1f0e08de1dbf None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:45:25.181668 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392939a-da15-410d-996f-1f0e08de1dbf None admin] PATH_INFO: `/v3/domains/69226181085e4323a381167aef795871` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:45:25.182815 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4392939a-da15-410d-996f-1f0e08de1dbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=69226181085e4323a381167aef795871)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:45:25.184777 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4392939a-da15-410d-996f-1f0e08de1dbf None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:45:25.186340 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 571/1176] 10.222.0.15 () {56 vars in 1183 bytes} [Sun Sep 18 00:45:25 2022] GET /identity/v3/domains/69226181085e4323a381167aef795871 => generated 267 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:45:25.192185 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df63dc0-592d-45b0-a413-52087a18d70e None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:45:25.294556 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df63dc0-592d-45b0-a413-52087a18d70e None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:45:25.328868 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7324a19d-cfdf-413b-9b48-20513ed6971d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:45:25.329472 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324a19d-cfdf-413b-9b48-20513ed6971d None admin] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:45:25.329748 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324a19d-cfdf-413b-9b48-20513ed6971d None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:45:25.330018 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324a19d-cfdf-413b-9b48-20513ed6971d None admin] PATH_INFO: `/v3/users` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:45:25.330676 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7324a19d-cfdf-413b-9b48-20513ed6971d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:45:25.332117 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7324a19d-cfdf-413b-9b48-20513ed6971d None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:45:25.352944 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 606/1177] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Sep 18 00:45:25 2022] POST /identity/v3/users => generated 311 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 00:45:27.536666 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c1944-eb2e-4735-a3fc-fbcfda5f14c8 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:45:27.537178 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c1944-eb2e-4735-a3fc-fbcfda5f14c8 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:45:27.537292 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c1944-eb2e-4735-a3fc-fbcfda5f14c8 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:45:27.538525 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 572/1178] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:45:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:45:27.544076 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a3a28-6b77-46b4-bfe4-2c2e883e3218 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:45:27.544475 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a3a28-6b77-46b4-bfe4-2c2e883e3218 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:45:27.544625 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a3a28-6b77-46b4-bfe4-2c2e883e3218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:45:27.562803 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-ae5a3a28-6b77-46b4-bfe4-2c2e883e3218 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:45:27.563992 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-ae5a3a28-6b77-46b4-bfe4-2c2e883e3218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:45:27.596733 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:45:27.630441 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 607/1179] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:45:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 00:45:27.903309 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819c1944-eb2e-4735-a3fc-fbcfda5f14c8 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:45:28.015870 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819c1944-eb2e-4735-a3fc-fbcfda5f14c8 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:45:28.051658 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9dd40c-1e61-4f93-a179-8546956795cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:45:28.052333 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9dd40c-1e61-4f93-a179-8546956795cd None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:45:28.052616 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9dd40c-1e61-4f93-a179-8546956795cd None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:45:28.052889 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9dd40c-1e61-4f93-a179-8546956795cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:45:28.064748 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9dd40c-1e61-4f93-a179-8546956795cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:45:28.069661 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-9b9dd40c-1e61-4f93-a179-8546956795cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 00:45:28.069661 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:45:28.069661 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:45:28.069661 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:45:28.069661 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:45:28.069661 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:45:28.069661 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:45:28.069661 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:45:28.069661 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:45:28.069661 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:45:28.069661 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:45:28.069661 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:45:28.069661 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:45:28.069661 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:45:28.069661 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:45:28.069661 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:45:28.070797 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:45:28.070797 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:45:28.070797 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:45:28.070797 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:45:28.070797 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:45:28.070797 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:45:28.070797 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:45:28.070797 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:45:28.070797 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:45:28.070797 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:45:28.070797 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:45:28.070797 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:45:28.070797 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:45:28.070797 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:45:28.070797 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:45:28.070797 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:45:28.071843 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:45:28.071843 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:45:28.071843 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:45:28.071843 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:45:28.071843 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:45:28.071843 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:45:28.071843 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:45:28.071843 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:45:28.071843 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:45:28.071843 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:45:28.071843 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 00:45:28.071843 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:45:28.071843 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 573/1180] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Sep 18 00:45:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:45:28.077683 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5a3a28-6b77-46b4-bfe4-2c2e883e3218 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:45:28.177860 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5a3a28-6b77-46b4-bfe4-2c2e883e3218 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:45:28.211542 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d57ac-137b-4967-ab5e-8eaa287449f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:45:28.212209 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d57ac-137b-4967-ab5e-8eaa287449f0 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:45:28.212463 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d57ac-137b-4967-ab5e-8eaa287449f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:45:28.212737 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d57ac-137b-4967-ab5e-8eaa287449f0 None admin] PATH_INFO: `/v3/roles` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:45:28.213397 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732d57ac-137b-4967-ab5e-8eaa287449f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:45:28.213703 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732d57ac-137b-4967-ab5e-8eaa287449f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:45:28.215786 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732d57ac-137b-4967-ab5e-8eaa287449f0 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:45:28.224328 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 608/1181] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Sep 18 00:45:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:45:28.231039 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9dd40c-1e61-4f93-a179-8546956795cd None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:45:28.279833 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:45:28.330508 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9dd40c-1e61-4f93-a179-8546956795cd None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:45:28.368134 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752bf1e2-70f5-4bb8-8f79-88ef917e583d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:45:28.368772 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752bf1e2-70f5-4bb8-8f79-88ef917e583d None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:45:28.369058 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752bf1e2-70f5-4bb8-8f79-88ef917e583d None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:45:28.369337 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752bf1e2-70f5-4bb8-8f79-88ef917e583d None admin] PATH_INFO: `/v3/users/f31d74a2b1d74b0496630c38e8917fc5` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:45:28.382309 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752bf1e2-70f5-4bb8-8f79-88ef917e583d None admin] RBAC: Authorizing `identity:get_user(user_id=f31d74a2b1d74b0496630c38e8917fc5)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:45:28.383764 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752bf1e2-70f5-4bb8-8f79-88ef917e583d None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:45:28.385419 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 574/1182] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Sep 18 00:45:28 2022] GET /identity/v3/users/f31d74a2b1d74b0496630c38e8917fc5 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:45:28.391442 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d57ac-137b-4967-ab5e-8eaa287449f0 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:45:28.423347 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:45:28.491572 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d57ac-137b-4967-ab5e-8eaa287449f0 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:45:28.524917 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e153c-000b-4285-8e62-71ba7d3da5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:45:28.525523 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e153c-000b-4285-8e62-71ba7d3da5d5 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:45:28.525801 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e153c-000b-4285-8e62-71ba7d3da5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:45:28.526071 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e153c-000b-4285-8e62-71ba7d3da5d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:45:28.591304 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8e153c-000b-4285-8e62-71ba7d3da5d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:45:28.592771 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8e153c-000b-4285-8e62-71ba7d3da5d5 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:45:28.627713 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:45:28.695656 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 609/1183] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Sep 18 00:45:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 18 00:45:28.701733 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752bf1e2-70f5-4bb8-8f79-88ef917e583d None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:45:28.799290 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752bf1e2-70f5-4bb8-8f79-88ef917e583d None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:45:28.809037 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:45:28.834114 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cc0cd0-4bbf-4f97-96f1-7d151b49bace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:45:28.834754 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc0cd0-4bbf-4f97-96f1-7d151b49bace None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:45:28.835036 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc0cd0-4bbf-4f97-96f1-7d151b49bace None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:45:28.835309 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc0cd0-4bbf-4f97-96f1-7d151b49bace None admin] PATH_INFO: `/v3/projects/a742c2a639fe44ac941c57868091d661` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:45:28.836451 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cc0cd0-4bbf-4f97-96f1-7d151b49bace None admin] RBAC: Authorizing `identity:get_project(project_id=a742c2a639fe44ac941c57868091d661)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:45:28.837884 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cc0cd0-4bbf-4f97-96f1-7d151b49bace None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:45:28.839515 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 575/1184] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Sep 18 00:45:28 2022] GET /identity/v3/projects/a742c2a639fe44ac941c57868091d661 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:45:28.846529 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e153c-000b-4285-8e62-71ba7d3da5d5 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:45:28.944043 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e153c-000b-4285-8e62-71ba7d3da5d5 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:45:28.972531 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:45:28.977810 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5912979-9fd2-43e9-817d-a00343b2afea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:45:28.978415 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5912979-9fd2-43e9-817d-a00343b2afea None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:45:28.978694 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5912979-9fd2-43e9-817d-a00343b2afea None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:45:28.978965 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5912979-9fd2-43e9-817d-a00343b2afea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:45:28.979674 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5912979-9fd2-43e9-817d-a00343b2afea None admin] RBAC: Adding query filter params (role.id=591d4711dc204cf98003c8b7d7558506, scope.project.id=a742c2a639fe44ac941c57868091d661, user.id=f31d74a2b1d74b0496630c38e8917fc5) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:45:28.980007 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5912979-9fd2-43e9-817d-a00343b2afea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:45:28.981455 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5912979-9fd2-43e9-817d-a00343b2afea None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:45:28.986699 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 610/1185] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Sep 18 00:45:28 2022] GET /identity/v3/role_assignments?user.id=f31d74a2b1d74b0496630c38e8917fc5&scope.project.id=a742c2a639fe44ac941c57868091d661&role.id=591d4711dc204cf98003c8b7d7558506 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:45:31.134529 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2186bf2c-5625-4814-a5bd-29be48983421 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:45:31.135063 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2186bf2c-5625-4814-a5bd-29be48983421 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:45:31.135063 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2186bf2c-5625-4814-a5bd-29be48983421 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:45:31.136444 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 576/1186] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:45:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:45:31.142201 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a7268-0e3c-4bc8-b053-660ba800e09c None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:45:31.142603 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a7268-0e3c-4bc8-b053-660ba800e09c None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:45:31.142764 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a7268-0e3c-4bc8-b053-660ba800e09c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:45:31.160816 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-944a7268-0e3c-4bc8-b053-660ba800e09c None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:45:31.162010 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-944a7268-0e3c-4bc8-b053-660ba800e09c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:45:31.227831 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 611/1187] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:45:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 00:45:31.499200 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2186bf2c-5625-4814-a5bd-29be48983421 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:45:31.601027 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2186bf2c-5625-4814-a5bd-29be48983421 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:45:31.634895 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f22f416-f3b8-4fcb-be13-86b941663b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:45:31.635530 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22f416-f3b8-4fcb-be13-86b941663b6a None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:45:31.635814 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22f416-f3b8-4fcb-be13-86b941663b6a None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:45:31.636116 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22f416-f3b8-4fcb-be13-86b941663b6a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:45:31.645962 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f22f416-f3b8-4fcb-be13-86b941663b6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:45:31.650730 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-9f22f416-f3b8-4fcb-be13-86b941663b6a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 00:45:31.650730 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:45:31.650730 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:45:31.650730 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:45:31.650730 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:45:31.650730 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:45:31.650730 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:45:31.650730 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:45:31.650730 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:45:31.650730 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:45:31.650730 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:45:31.650730 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:45:31.650730 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:45:31.650730 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:45:31.650730 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:45:31.650730 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:45:31.651795 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:45:31.651795 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:45:31.651795 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:45:31.651795 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:45:31.651795 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:45:31.651795 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:45:31.651795 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:45:31.651795 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:45:31.651795 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:45:31.651795 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:45:31.651795 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:45:31.651795 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:45:31.651795 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:45:31.651795 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:45:31.651795 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:45:31.651795 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:45:31.652827 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:45:31.652827 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:45:31.652827 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:45:31.652827 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:45:31.652827 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:45:31.652827 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:45:31.652827 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:45:31.652827 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:45:31.652827 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:45:31.652827 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:45:31.652827 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 00:45:31.652827 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:45:31.652827 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 577/1188] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Sep 18 00:45:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:45:31.657927 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a7268-0e3c-4bc8-b053-660ba800e09c None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:45:31.756367 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a7268-0e3c-4bc8-b053-660ba800e09c None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:45:31.780245 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:45:31.789038 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e10416-dd8a-4b30-b321-35b14861c1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:45:31.789895 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e10416-dd8a-4b30-b321-35b14861c1f0 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:45:31.790172 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e10416-dd8a-4b30-b321-35b14861c1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:45:31.790442 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e10416-dd8a-4b30-b321-35b14861c1f0 None admin] PATH_INFO: `/v3/roles` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:45:31.791091 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e10416-dd8a-4b30-b321-35b14861c1f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:45:31.791390 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e10416-dd8a-4b30-b321-35b14861c1f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:45:31.793296 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e10416-dd8a-4b30-b321-35b14861c1f0 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:45:31.801040 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 612/1189] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Sep 18 00:45:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:45:31.807590 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f22f416-f3b8-4fcb-be13-86b941663b6a None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:45:31.842218 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:45:31.905387 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f22f416-f3b8-4fcb-be13-86b941663b6a None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:45:31.939239 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e95fcd-6dca-486c-83ad-101479efa362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:45:31.939858 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e95fcd-6dca-486c-83ad-101479efa362 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:45:31.940164 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e95fcd-6dca-486c-83ad-101479efa362 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:45:31.940431 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e95fcd-6dca-486c-83ad-101479efa362 None admin] PATH_INFO: `/v3/users/f31d74a2b1d74b0496630c38e8917fc5` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:45:31.941524 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e95fcd-6dca-486c-83ad-101479efa362 None admin] RBAC: Authorizing `identity:get_user(user_id=f31d74a2b1d74b0496630c38e8917fc5)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:45:31.942940 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e95fcd-6dca-486c-83ad-101479efa362 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:45:31.944528 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 578/1190] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Sep 18 00:45:31 2022] GET /identity/v3/users/f31d74a2b1d74b0496630c38e8917fc5 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:45:31.951235 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e10416-dd8a-4b30-b321-35b14861c1f0 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:45:32.056960 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e10416-dd8a-4b30-b321-35b14861c1f0 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:45:32.090024 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3415a2-09f1-4e8b-bba1-fd5b94553411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:45:32.090659 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3415a2-09f1-4e8b-bba1-fd5b94553411 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:45:32.090942 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3415a2-09f1-4e8b-bba1-fd5b94553411 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:45:32.091219 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3415a2-09f1-4e8b-bba1-fd5b94553411 None admin] PATH_INFO: `/v3/projects/a742c2a639fe44ac941c57868091d661` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:45:32.092357 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3415a2-09f1-4e8b-bba1-fd5b94553411 None admin] RBAC: Authorizing `identity:get_project(project_id=a742c2a639fe44ac941c57868091d661)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:45:32.093795 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3415a2-09f1-4e8b-bba1-fd5b94553411 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:45:32.095436 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 613/1191] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Sep 18 00:45:31 2022] GET /identity/v3/projects/a742c2a639fe44ac941c57868091d661 => generated 361 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:45:32.101596 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e95fcd-6dca-486c-83ad-101479efa362 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:45:32.198904 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e95fcd-6dca-486c-83ad-101479efa362 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:45:32.201195 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:45:32.232985 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e732db93-fd14-4410-88ad-65cb24a9a7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:45:32.233646 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732db93-fd14-4410-88ad-65cb24a9a7eb None admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:45:32.233921 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732db93-fd14-4410-88ad-65cb24a9a7eb None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:45:32.234193 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732db93-fd14-4410-88ad-65cb24a9a7eb None admin] PATH_INFO: `/v3/projects/a742c2a639fe44ac941c57868091d661/users/f31d74a2b1d74b0496630c38e8917fc5/roles/591d4711dc204cf98003c8b7d7558506` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:45:32.236086 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e732db93-fd14-4410-88ad-65cb24a9a7eb None admin] RBAC: Authorizing `identity:create_grant(project_id=a742c2a639fe44ac941c57868091d661, user_id=f31d74a2b1d74b0496630c38e8917fc5, role_id=591d4711dc204cf98003c8b7d7558506)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:45:32.237515 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e732db93-fd14-4410-88ad-65cb24a9a7eb None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:45:32.249527 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 579/1192] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Sep 18 00:45:32 2022] PUT /identity/v3/projects/a742c2a639fe44ac941c57868091d661/users/f31d74a2b1d74b0496630c38e8917fc5/roles/591d4711dc204cf98003c8b7d7558506 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 00:45:34.370022 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd9abe-6acb-4695-a2cc-e120bd21ceb3 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:45:34.370633 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd9abe-6acb-4695-a2cc-e120bd21ceb3 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:45:34.370633 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd9abe-6acb-4695-a2cc-e120bd21ceb3 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:45:34.372808 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 614/1193] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:45:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:45:34.378454 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c47c82e-6667-49d5-b67a-7a370f3d9df4 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:45:34.378922 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c47c82e-6667-49d5-b67a-7a370f3d9df4 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:45:34.379117 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c47c82e-6667-49d5-b67a-7a370f3d9df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:45:34.398051 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-8c47c82e-6667-49d5-b67a-7a370f3d9df4 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:45:34.399297 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-8c47c82e-6667-49d5-b67a-7a370f3d9df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:45:34.472247 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 580/1194] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:45:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 00:45:34.751696 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fd9abe-6acb-4695-a2cc-e120bd21ceb3 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:45:34.807962 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:45:34.852654 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fd9abe-6acb-4695-a2cc-e120bd21ceb3 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:45:34.885842 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5362632-3f4f-49ff-85f1-efcc0bbd99e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:45:34.887020 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5362632-3f4f-49ff-85f1-efcc0bbd99e4 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:45:34.887309 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5362632-3f4f-49ff-85f1-efcc0bbd99e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:45:34.887586 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5362632-3f4f-49ff-85f1-efcc0bbd99e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:45:34.898654 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5362632-3f4f-49ff-85f1-efcc0bbd99e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:45:34.903442 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-a5362632-3f4f-49ff-85f1-efcc0bbd99e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 00:45:34.903442 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:45:34.903442 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:45:34.903442 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:45:34.903442 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:45:34.903442 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:45:34.903442 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:45:34.903442 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:45:34.903442 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:45:34.903442 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:45:34.903442 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:45:34.903442 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:45:34.903442 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:45:34.903442 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:45:34.903442 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:45:34.903442 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:45:34.904509 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:45:34.904509 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:45:34.904509 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:45:34.904509 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:45:34.904509 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:45:34.904509 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:45:34.904509 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:45:34.904509 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:45:34.904509 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:45:34.904509 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:45:34.904509 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:45:34.904509 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:45:34.904509 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:45:34.904509 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:45:34.904509 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:45:34.904509 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:45:34.905530 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:45:34.905530 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:45:34.905530 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:45:34.905530 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:45:34.905530 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:45:34.905530 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:45:34.905530 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:45:34.905530 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:45:34.905530 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:45:34.905530 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:45:34.905530 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 00:45:34.905530 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:45:34.905530 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 615/1195] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Sep 18 00:45:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:45:34.910721 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c47c82e-6667-49d5-b67a-7a370f3d9df4 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:45:35.009896 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:45:35.017772 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c47c82e-6667-49d5-b67a-7a370f3d9df4 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:45:35.051402 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a2ae6-7ddb-4665-8fa0-d070decb1ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:45:35.052050 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a2ae6-7ddb-4665-8fa0-d070decb1ee5 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:45:35.052336 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a2ae6-7ddb-4665-8fa0-d070decb1ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:45:35.052614 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a2ae6-7ddb-4665-8fa0-d070decb1ee5 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:45:35.053273 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1a2ae6-7ddb-4665-8fa0-d070decb1ee5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:45:35.053581 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1a2ae6-7ddb-4665-8fa0-d070decb1ee5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:45:35.054956 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1a2ae6-7ddb-4665-8fa0-d070decb1ee5 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:45:35.063535 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 581/1196] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Sep 18 00:45:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:45:35.069697 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5362632-3f4f-49ff-85f1-efcc0bbd99e4 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:45:35.166407 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5362632-3f4f-49ff-85f1-efcc0bbd99e4 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:45:35.181859 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:45:35.200056 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264ac9c-dae8-4ee0-a46e-3d57697fdff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:45:35.200690 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264ac9c-dae8-4ee0-a46e-3d57697fdff0 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:45:35.200974 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264ac9c-dae8-4ee0-a46e-3d57697fdff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:45:35.201253 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264ac9c-dae8-4ee0-a46e-3d57697fdff0 None admin] PATH_INFO: `/v3/users/f31d74a2b1d74b0496630c38e8917fc5` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:45:35.202372 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4264ac9c-dae8-4ee0-a46e-3d57697fdff0 None admin] RBAC: Authorizing `identity:get_user(user_id=f31d74a2b1d74b0496630c38e8917fc5)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:45:35.203813 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4264ac9c-dae8-4ee0-a46e-3d57697fdff0 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:45:35.205468 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 616/1197] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Sep 18 00:45:35 2022] GET /identity/v3/users/f31d74a2b1d74b0496630c38e8917fc5 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:45:35.211245 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a2ae6-7ddb-4665-8fa0-d070decb1ee5 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:45:35.312233 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a2ae6-7ddb-4665-8fa0-d070decb1ee5 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:45:35.344211 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c2c67f-d8ee-445a-ae9d-b47cdfcb4462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:45:35.344811 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2c67f-d8ee-445a-ae9d-b47cdfcb4462 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:45:35.345093 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2c67f-d8ee-445a-ae9d-b47cdfcb4462 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:45:35.345370 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2c67f-d8ee-445a-ae9d-b47cdfcb4462 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:45:35.369472 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:45:35.413243 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c2c67f-d8ee-445a-ae9d-b47cdfcb4462 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:45:35.414948 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c2c67f-d8ee-445a-ae9d-b47cdfcb4462 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:45:35.512193 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 582/1198] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Sep 18 00:45:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 18 00:45:35.518100 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264ac9c-dae8-4ee0-a46e-3d57697fdff0 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:45:35.615651 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264ac9c-dae8-4ee0-a46e-3d57697fdff0 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:45:35.648949 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5605ec3-fc0c-4613-80d3-e40e35f53f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:45:35.649572 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5605ec3-fc0c-4613-80d3-e40e35f53f93 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:45:35.649849 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5605ec3-fc0c-4613-80d3-e40e35f53f93 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:45:35.650118 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5605ec3-fc0c-4613-80d3-e40e35f53f93 None admin] PATH_INFO: `/v3/projects/a742c2a639fe44ac941c57868091d661` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:45:35.651212 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5605ec3-fc0c-4613-80d3-e40e35f53f93 None admin] RBAC: Authorizing `identity:get_project(project_id=a742c2a639fe44ac941c57868091d661)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:45:35.652685 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5605ec3-fc0c-4613-80d3-e40e35f53f93 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:45:35.654309 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 617/1199] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Sep 18 00:45:35 2022] GET /identity/v3/projects/a742c2a639fe44ac941c57868091d661 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:45:35.660677 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c2c67f-d8ee-445a-ae9d-b47cdfcb4462 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:45:35.716724 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:45:35.759991 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c2c67f-d8ee-445a-ae9d-b47cdfcb4462 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:45:35.793031 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9fdd64-83a9-4cfd-9fff-6a5155bf4f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:45:35.793635 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9fdd64-83a9-4cfd-9fff-6a5155bf4f34 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:45:35.793916 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9fdd64-83a9-4cfd-9fff-6a5155bf4f34 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:45:35.794191 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9fdd64-83a9-4cfd-9fff-6a5155bf4f34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:45:35.794906 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9fdd64-83a9-4cfd-9fff-6a5155bf4f34 None admin] RBAC: Adding query filter params (role.id=591d4711dc204cf98003c8b7d7558506, scope.project.id=a742c2a639fe44ac941c57868091d661, user.id=f31d74a2b1d74b0496630c38e8917fc5) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:45:35.795212 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9fdd64-83a9-4cfd-9fff-6a5155bf4f34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:45:35.796685 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9fdd64-83a9-4cfd-9fff-6a5155bf4f34 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:45:35.802264 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 583/1200] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Sep 18 00:45:35 2022] GET /identity/v3/role_assignments?user.id=f31d74a2b1d74b0496630c38e8917fc5&scope.project.id=a742c2a639fe44ac941c57868091d661&role.id=591d4711dc204cf98003c8b7d7558506 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:45:45.644924 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=74 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:45:45.800713 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=40 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:46:33.124787 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd12997b-aab9-4b02-bc9a-b8dec19f6cea None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:46:33.125679 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd12997b-aab9-4b02-bc9a-b8dec19f6cea None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:46:33.125679 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd12997b-aab9-4b02-bc9a-b8dec19f6cea None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:46:33.130974 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 618/1201] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:46:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:46:33.140302 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418436a9-225e-4f0a-8c2f-7da57536e1b3 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:46:33.141066 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418436a9-225e-4f0a-8c2f-7da57536e1b3 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:46:33.141066 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418436a9-225e-4f0a-8c2f-7da57536e1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:46:33.171515 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-418436a9-225e-4f0a-8c2f-7da57536e1b3 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:46:33.173717 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-418436a9-225e-4f0a-8c2f-7da57536e1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:46:33.314117 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 584/1202] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:46:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 18 00:46:33.661710 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd12997b-aab9-4b02-bc9a-b8dec19f6cea None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:46:33.904574 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd12997b-aab9-4b02-bc9a-b8dec19f6cea None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:46:33.970226 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb8b1c-101a-4f73-b771-88118e560fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:46:33.971022 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb8b1c-101a-4f73-b771-88118e560fe5 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:46:33.971354 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb8b1c-101a-4f73-b771-88118e560fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:46:33.971628 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb8b1c-101a-4f73-b771-88118e560fe5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:46:33.987279 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abb8b1c-101a-4f73-b771-88118e560fe5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:46:33.988965 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abb8b1c-101a-4f73-b771-88118e560fe5 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:46:34.006212 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-3abb8b1c-101a-4f73-b771-88118e560fe5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:46:34.006212 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:46:34.006212 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:46:34.006212 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:46:34.006212 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:46:34.006212 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:46:34.006212 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:46:34.006212 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:46:34.006212 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:46:34.006212 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:46:34.006212 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:46:34.006212 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:46:34.006212 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:46:34.006212 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:46:34.006212 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:46:34.006212 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:46:34.008594 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:46:34.008594 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:46:34.008594 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:46:34.008594 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:46:34.008594 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:46:34.008594 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:46:34.008594 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:46:34.008594 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:46:34.008594 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:46:34.008594 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:46:34.008594 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:46:34.008594 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:46:34.008594 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:46:34.008594 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:46:34.008594 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:46:34.008594 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:46:34.008594 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:46:34.010187 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:46:34.010187 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:46:34.010187 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:46:34.010187 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 619/1203] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:46:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:46:34.014760 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418436a9-225e-4f0a-8c2f-7da57536e1b3 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:46:34.223510 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418436a9-225e-4f0a-8c2f-7da57536e1b3 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:46:34.282572 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:46:34.293106 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab354c-3c5a-4f59-993a-7f8d420a5ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:46:34.294491 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab354c-3c5a-4f59-993a-7f8d420a5ba5 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:46:34.295192 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab354c-3c5a-4f59-993a-7f8d420a5ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:46:34.295870 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab354c-3c5a-4f59-993a-7f8d420a5ba5 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:46:34.297269 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfab354c-3c5a-4f59-993a-7f8d420a5ba5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:46:34.297803 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfab354c-3c5a-4f59-993a-7f8d420a5ba5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:46:34.300325 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfab354c-3c5a-4f59-993a-7f8d420a5ba5 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:46:34.330060 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 585/1204] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:46:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:46:34.332280 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb8b1c-101a-4f73-b771-88118e560fe5 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:46:34.419266 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:46:34.503369 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb8b1c-101a-4f73-b771-88118e560fe5 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:46:34.573668 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad5ab1e-7d83-4146-8355-c55c48800ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:46:34.574497 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad5ab1e-7d83-4146-8355-c55c48800ada None admin] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:46:34.574884 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad5ab1e-7d83-4146-8355-c55c48800ada None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:46:34.575308 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad5ab1e-7d83-4146-8355-c55c48800ada None admin] PATH_INFO: `/v3/users` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:46:34.576347 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad5ab1e-7d83-4146-8355-c55c48800ada None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:46:34.578900 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad5ab1e-7d83-4146-8355-c55c48800ada None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:46:34.613824 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 620/1205] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Sep 18 00:46:34 2022] POST /identity/v3/users => generated 251 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 00:46:37.803243 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16982a6a-fbad-4b68-a32b-07b3350e774a None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:46:37.804302 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16982a6a-fbad-4b68-a32b-07b3350e774a None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:46:37.804302 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16982a6a-fbad-4b68-a32b-07b3350e774a None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:46:37.805705 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 586/1206] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:46:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 18 00:46:37.811503 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade3837-2e2e-4dce-8fd5-737a1838a57a None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:46:37.812359 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade3837-2e2e-4dce-8fd5-737a1838a57a None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:46:37.812359 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade3837-2e2e-4dce-8fd5-737a1838a57a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:46:37.835376 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-8ade3837-2e2e-4dce-8fd5-737a1838a57a None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:46:37.835376 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-8ade3837-2e2e-4dce-8fd5-737a1838a57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:46:37.937710 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 621/1207] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:46:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 00:46:38.226003 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16982a6a-fbad-4b68-a32b-07b3350e774a None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:46:38.383776 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16982a6a-fbad-4b68-a32b-07b3350e774a None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:46:38.443143 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1133c48-0f68-42f9-9ba1-c0ed81cc7253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:46:38.444087 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1133c48-0f68-42f9-9ba1-c0ed81cc7253 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:46:38.444545 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1133c48-0f68-42f9-9ba1-c0ed81cc7253 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:46:38.444894 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1133c48-0f68-42f9-9ba1-c0ed81cc7253 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:46:38.463363 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1133c48-0f68-42f9-9ba1-c0ed81cc7253 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:46:38.473060 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-d1133c48-0f68-42f9-9ba1-c0ed81cc7253 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 18 00:46:38.473060 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:46:38.473060 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:46:38.473060 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:46:38.473060 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:46:38.473060 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:46:38.473060 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:46:38.473060 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:46:38.473060 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:46:38.473060 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:46:38.473060 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:46:38.473060 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:46:38.473060 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:46:38.473060 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:46:38.473060 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:46:38.473060 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:46:38.474318 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:46:38.474318 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:46:38.474318 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:46:38.474318 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:46:38.474318 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:46:38.474318 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:46:38.474318 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:46:38.474318 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:46:38.474318 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:46:38.474318 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:46:38.474318 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:46:38.474318 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:46:38.474318 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:46:38.474318 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:46:38.474318 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:46:38.474318 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:46:38.475537 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:46:38.475537 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:46:38.475537 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:46:38.475537 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:46:38.475537 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:46:38.475537 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:46:38.475537 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:46:38.475537 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:46:38.475537 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:46:38.475537 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:46:38.475537 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 18 00:46:38.475537 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:46:38.475537 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 587/1208] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Sep 18 00:46:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 00:46:38.484427 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ade3837-2e2e-4dce-8fd5-737a1838a57a None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:46:38.545966 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:46:38.641940 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ade3837-2e2e-4dce-8fd5-737a1838a57a None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:46:38.707125 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce45b0f-941d-42b5-b47f-1fd90b04a985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:46:38.707920 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce45b0f-941d-42b5-b47f-1fd90b04a985 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:46:38.708586 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce45b0f-941d-42b5-b47f-1fd90b04a985 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:46:38.708958 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce45b0f-941d-42b5-b47f-1fd90b04a985 None admin] PATH_INFO: `/v3/roles` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:46:38.709775 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce45b0f-941d-42b5-b47f-1fd90b04a985 None admin] RBAC: Adding query filter params (name=service) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:46:38.710206 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce45b0f-941d-42b5-b47f-1fd90b04a985 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:46:38.712714 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce45b0f-941d-42b5-b47f-1fd90b04a985 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:46:38.728142 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 622/1209] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Sep 18 00:46:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:46:38.737284 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1133c48-0f68-42f9-9ba1-c0ed81cc7253 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:46:38.812834 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:46:38.883080 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1133c48-0f68-42f9-9ba1-c0ed81cc7253 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:46:38.938702 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bbf5b3-6b22-4047-9e36-59f0026a472e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:46:38.939597 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbf5b3-6b22-4047-9e36-59f0026a472e None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:46:38.940046 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbf5b3-6b22-4047-9e36-59f0026a472e None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:46:38.940514 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbf5b3-6b22-4047-9e36-59f0026a472e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:46:38.957548 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bbf5b3-6b22-4047-9e36-59f0026a472e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:46:38.960323 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bbf5b3-6b22-4047-9e36-59f0026a472e None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:46:38.985201 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-51bbf5b3-6b22-4047-9e36-59f0026a472e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:46:38.985201 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:46:38.985201 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:46:38.985201 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:46:38.985201 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:46:38.985201 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:46:38.985201 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:46:38.985201 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:46:38.985201 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:46:38.985201 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:46:38.985201 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:46:38.985201 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:46:38.985201 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:46:38.985201 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:46:38.985201 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:46:38.985201 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:46:38.988128 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:46:38.988128 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:46:38.988128 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:46:38.988128 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:46:38.988128 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:46:38.988128 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:46:38.988128 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:46:38.988128 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:46:38.988128 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:46:38.988128 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:46:38.988128 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:46:38.988128 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:46:38.988128 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:46:38.988128 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:46:38.988128 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:46:38.988128 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:46:38.988128 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:46:38.990412 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:46:38.990412 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:46:38.990412 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:46:38.995939 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 588/1210] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:46:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:46:38.996625 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce45b0f-941d-42b5-b47f-1fd90b04a985 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:46:39.183236 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:46:39.187645 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce45b0f-941d-42b5-b47f-1fd90b04a985 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:46:39.250801 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbec0af-24fb-47f6-9945-dbf49aa4b3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:46:39.251369 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbec0af-24fb-47f6-9945-dbf49aa4b3f2 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:46:39.251847 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbec0af-24fb-47f6-9945-dbf49aa4b3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:46:39.252365 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbec0af-24fb-47f6-9945-dbf49aa4b3f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:46:39.253490 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbec0af-24fb-47f6-9945-dbf49aa4b3f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:46:39.254022 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbec0af-24fb-47f6-9945-dbf49aa4b3f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:46:39.256037 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbec0af-24fb-47f6-9945-dbf49aa4b3f2 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:46:39.275953 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 623/1211] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:46:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:46:39.282765 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bbf5b3-6b22-4047-9e36-59f0026a472e None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:46:39.445975 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bbf5b3-6b22-4047-9e36-59f0026a472e None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:46:39.448249 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:46:39.493242 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9be976-631f-4cd9-962c-de88f5a185c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:46:39.493903 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9be976-631f-4cd9-962c-de88f5a185c4 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:46:39.494183 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9be976-631f-4cd9-962c-de88f5a185c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:46:39.494457 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9be976-631f-4cd9-962c-de88f5a185c4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:46:39.505402 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9be976-631f-4cd9-962c-de88f5a185c4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:46:39.507345 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9be976-631f-4cd9-962c-de88f5a185c4 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:46:39.528629 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-2f9be976-631f-4cd9-962c-de88f5a185c4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 18 00:46:39.528629 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:46:39.528629 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:46:39.528629 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:46:39.528629 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:46:39.528629 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:46:39.528629 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:46:39.528629 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:46:39.528629 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:46:39.528629 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:46:39.528629 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:46:39.528629 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:46:39.528629 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 00:46:39.528629 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 00:46:39.528629 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 00:46:39.528629 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 00:46:39.530169 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:46:39.530169 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:46:39.530169 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 00:46:39.530169 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:46:39.530169 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 00:46:39.530169 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:46:39.530169 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:46:39.530169 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:46:39.530169 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:46:39.530169 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:46:39.530169 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:46:39.530169 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:46:39.530169 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:46:39.530169 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:46:39.530169 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:46:39.530169 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:46:39.530169 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:46:39.530169 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:46:39.533640 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:46:39.533640 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:46:39.533640 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 00:46:39.533640 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 00:46:39.533640 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 00:46:39.533640 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 00:46:39.533640 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 00:46:39.533640 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 00:46:39.533640 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 18 00:46:39.533640 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:46:39.533640 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 589/1212] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:46:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:46:39.540816 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbec0af-24fb-47f6-9945-dbf49aa4b3f2 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:46:39.749949 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbec0af-24fb-47f6-9945-dbf49aa4b3f2 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:46:39.798078 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5909dccd-56c6-4e5a-a839-90d74a274fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:46:39.798710 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909dccd-56c6-4e5a-a839-90d74a274fce None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:46:39.799076 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909dccd-56c6-4e5a-a839-90d74a274fce None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:46:39.799427 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909dccd-56c6-4e5a-a839-90d74a274fce None admin] PATH_INFO: `/v3/users` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:46:39.800250 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5909dccd-56c6-4e5a-a839-90d74a274fce None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:46:39.800644 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5909dccd-56c6-4e5a-a839-90d74a274fce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:46:39.802246 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5909dccd-56c6-4e5a-a839-90d74a274fce None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:46:39.829936 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 624/1213] 10.222.0.15 () {56 vars in 1143 bytes} [Sun Sep 18 00:46:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:46:39.832044 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9be976-631f-4cd9-962c-de88f5a185c4 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:46:40.029320 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9be976-631f-4cd9-962c-de88f5a185c4 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:46:40.097965 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bbb8af-54b5-43f9-bdb8-9198632b49ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:46:40.098930 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bbb8af-54b5-43f9-bdb8-9198632b49ba None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:46:40.099418 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bbb8af-54b5-43f9-bdb8-9198632b49ba None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:46:40.099929 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bbb8af-54b5-43f9-bdb8-9198632b49ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:46:40.147092 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:46:40.230772 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bbb8af-54b5-43f9-bdb8-9198632b49ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:46:40.232594 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bbb8af-54b5-43f9-bdb8-9198632b49ba None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:46:40.433147 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 590/1214] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Sep 18 00:46:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 18 00:46:40.442795 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5909dccd-56c6-4e5a-a839-90d74a274fce None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:46:40.479364 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:46:40.604522 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5909dccd-56c6-4e5a-a839-90d74a274fce None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:46:40.650146 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e9d7c8-4d03-46ad-94da-dc8874d4532a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:46:40.651734 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9d7c8-4d03-46ad-94da-dc8874d4532a None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:46:40.652215 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9d7c8-4d03-46ad-94da-dc8874d4532a None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:46:40.652649 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9d7c8-4d03-46ad-94da-dc8874d4532a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:46:40.676456 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e9d7c8-4d03-46ad-94da-dc8874d4532a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:46:40.680075 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e9d7c8-4d03-46ad-94da-dc8874d4532a None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:46:40.708930 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-22e9d7c8-4d03-46ad-94da-dc8874d4532a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:46:40.708930 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:46:40.708930 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:46:40.708930 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:46:40.708930 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:46:40.708930 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:46:40.708930 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:46:40.708930 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:46:40.708930 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:46:40.708930 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:46:40.708930 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:46:40.708930 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:46:40.708930 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:46:40.708930 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:46:40.708930 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:46:40.708930 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:46:40.709949 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:46:40.709949 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:46:40.709949 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:46:40.709949 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:46:40.709949 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:46:40.709949 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:46:40.709949 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:46:40.709949 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:46:40.709949 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:46:40.709949 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:46:40.709949 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:46:40.709949 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:46:40.709949 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:46:40.709949 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:46:40.709949 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:46:40.709949 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:46:40.709949 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:46:40.710945 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:46:40.710945 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:46:40.710945 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:46:40.716375 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 625/1215] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:46:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:46:40.720064 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bbb8af-54b5-43f9-bdb8-9198632b49ba None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:46:40.841891 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:46:40.919456 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bbb8af-54b5-43f9-bdb8-9198632b49ba None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:46:41.010877 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d801bf-7eb9-465a-bf8b-7aa994ab3aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:46:41.011771 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d801bf-7eb9-465a-bf8b-7aa994ab3aec None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:46:41.012320 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d801bf-7eb9-465a-bf8b-7aa994ab3aec None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:46:41.012818 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d801bf-7eb9-465a-bf8b-7aa994ab3aec None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:46:41.014292 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d801bf-7eb9-465a-bf8b-7aa994ab3aec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:46:41.014789 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d801bf-7eb9-465a-bf8b-7aa994ab3aec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:46:41.018637 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d801bf-7eb9-465a-bf8b-7aa994ab3aec None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:46:41.046360 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 591/1216] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:46:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:46:41.057782 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e9d7c8-4d03-46ad-94da-dc8874d4532a None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:46:41.169127 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:46:41.228371 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e9d7c8-4d03-46ad-94da-dc8874d4532a None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:46:41.280690 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d118b3ab-0df3-4133-a5a8-b877d1ee75af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:46:41.281691 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118b3ab-0df3-4133-a5a8-b877d1ee75af None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:46:41.282057 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118b3ab-0df3-4133-a5a8-b877d1ee75af None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:46:41.282472 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118b3ab-0df3-4133-a5a8-b877d1ee75af None admin] PATH_INFO: `/v3/projects/service` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:46:41.292274 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d118b3ab-0df3-4133-a5a8-b877d1ee75af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:46:41.294070 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d118b3ab-0df3-4133-a5a8-b877d1ee75af None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:46:41.320526 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-d118b3ab-0df3-4133-a5a8-b877d1ee75af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:46:41.320526 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:46:41.320526 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:46:41.320526 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:46:41.320526 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:46:41.320526 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:46:41.320526 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:46:41.320526 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:46:41.320526 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:46:41.320526 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:46:41.320526 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:46:41.320526 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:46:41.320526 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 00:46:41.320526 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 00:46:41.320526 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 00:46:41.321687 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 00:46:41.321687 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:46:41.321687 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:46:41.321687 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:46:41.321687 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:46:41.321687 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:46:41.321687 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:46:41.321687 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:46:41.321687 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:46:41.321687 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:46:41.321687 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:46:41.321687 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:46:41.321687 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:46:41.321687 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:46:41.321687 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:46:41.321687 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:46:41.321687 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:46:41.322660 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 00:46:41.322660 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 00:46:41.322660 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 00:46:41.322660 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 00:46:41.322660 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 00:46:41.322660 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 00:46:41.322660 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:46:41.322660 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:46:41.331910 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 626/1217] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Sep 18 00:46:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:46:41.333599 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d801bf-7eb9-465a-bf8b-7aa994ab3aec None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:46:41.491453 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d801bf-7eb9-465a-bf8b-7aa994ab3aec None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:46:41.523971 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:46:41.545127 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936ebc5-31c4-43d5-9f83-51d37a64144c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:46:41.546094 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936ebc5-31c4-43d5-9f83-51d37a64144c None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:46:41.546509 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936ebc5-31c4-43d5-9f83-51d37a64144c None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:46:41.546947 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936ebc5-31c4-43d5-9f83-51d37a64144c None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:46:41.548147 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b936ebc5-31c4-43d5-9f83-51d37a64144c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:46:41.548618 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b936ebc5-31c4-43d5-9f83-51d37a64144c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:46:41.551138 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b936ebc5-31c4-43d5-9f83-51d37a64144c None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:46:41.575005 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 592/1218] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Sep 18 00:46:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:46:41.583626 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d118b3ab-0df3-4133-a5a8-b877d1ee75af None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:46:41.734619 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d118b3ab-0df3-4133-a5a8-b877d1ee75af None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:46:41.784245 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:46:41.795671 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69261ce1-9ea0-4107-acd5-b101e2ef32fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:46:41.796651 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69261ce1-9ea0-4107-acd5-b101e2ef32fb None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:46:41.797091 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69261ce1-9ea0-4107-acd5-b101e2ef32fb None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:46:41.797580 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69261ce1-9ea0-4107-acd5-b101e2ef32fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:46:41.798966 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69261ce1-9ea0-4107-acd5-b101e2ef32fb None admin] RBAC: Adding query filter params (role.id=5e91422b372b43749fe857ffd7bba774, scope.project.id=52ebde8fa3f84ede9ef575f7c0780798, user.id=7239e730ee034affb6bdf27e106c49cb) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:46:41.799521 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69261ce1-9ea0-4107-acd5-b101e2ef32fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:46:41.802199 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69261ce1-9ea0-4107-acd5-b101e2ef32fb None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:46:41.812538 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 627/1219] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Sep 18 00:46:41 2022] GET /identity/v3/role_assignments?user.id=7239e730ee034affb6bdf27e106c49cb&scope.project.id=52ebde8fa3f84ede9ef575f7c0780798&role.id=5e91422b372b43749fe857ffd7bba774 => generated 259 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:46:44.254425 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb30cbe-412d-4e84-9e3c-f49d82b1957a None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:46:44.255028 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb30cbe-412d-4e84-9e3c-f49d82b1957a None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:46:44.255028 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb30cbe-412d-4e84-9e3c-f49d82b1957a None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:46:44.256468 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 593/1220] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:46:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 18 00:46:44.262721 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead1dab-315b-4b9c-99f1-601c9eb59977 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:46:44.263442 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead1dab-315b-4b9c-99f1-601c9eb59977 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:46:44.263442 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead1dab-315b-4b9c-99f1-601c9eb59977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:46:44.284470 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-1ead1dab-315b-4b9c-99f1-601c9eb59977 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:46:44.285694 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-1ead1dab-315b-4b9c-99f1-601c9eb59977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:46:44.366414 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 628/1221] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:46:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 00:46:44.672150 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb30cbe-412d-4e84-9e3c-f49d82b1957a None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:46:44.845453 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb30cbe-412d-4e84-9e3c-f49d82b1957a None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:46:44.899914 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64351cf-7326-4540-b188-ccf5dc7fd118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:46:44.900816 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64351cf-7326-4540-b188-ccf5dc7fd118 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:46:44.901152 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64351cf-7326-4540-b188-ccf5dc7fd118 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:46:44.901481 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64351cf-7326-4540-b188-ccf5dc7fd118 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:46:44.917922 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64351cf-7326-4540-b188-ccf5dc7fd118 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:46:44.923693 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-b64351cf-7326-4540-b188-ccf5dc7fd118 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 18 00:46:44.923693 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:46:44.923693 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:46:44.923693 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:46:44.923693 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:46:44.923693 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:46:44.923693 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:46:44.923693 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:46:44.923693 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:46:44.923693 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:46:44.923693 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:46:44.923693 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:46:44.923693 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:46:44.923693 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:46:44.923693 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:46:44.923693 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:46:44.924772 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:46:44.924772 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:46:44.924772 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:46:44.924772 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:46:44.924772 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:46:44.924772 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:46:44.924772 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:46:44.924772 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:46:44.924772 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:46:44.924772 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:46:44.924772 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:46:44.924772 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:46:44.924772 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:46:44.924772 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:46:44.924772 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:46:44.924772 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:46:44.925785 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:46:44.925785 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:46:44.925785 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:46:44.925785 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:46:44.925785 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:46:44.925785 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:46:44.925785 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:46:44.925785 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:46:44.925785 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:46:44.925785 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:46:44.925785 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 18 00:46:44.925785 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:46:44.925785 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 594/1222] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Sep 18 00:46:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:46:44.934012 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead1dab-315b-4b9c-99f1-601c9eb59977 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:46:45.102691 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead1dab-315b-4b9c-99f1-601c9eb59977 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:46:45.131298 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:46:45.147016 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f963e8-0a4e-44e0-9d03-b1803ce0b631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:46:45.148630 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f963e8-0a4e-44e0-9d03-b1803ce0b631 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:46:45.149139 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f963e8-0a4e-44e0-9d03-b1803ce0b631 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:46:45.149634 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f963e8-0a4e-44e0-9d03-b1803ce0b631 None admin] PATH_INFO: `/v3/roles` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:46:45.150738 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f963e8-0a4e-44e0-9d03-b1803ce0b631 None admin] RBAC: Adding query filter params (name=service) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:46:45.151286 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f963e8-0a4e-44e0-9d03-b1803ce0b631 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:46:45.153380 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f963e8-0a4e-44e0-9d03-b1803ce0b631 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:46:45.167030 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 629/1223] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Sep 18 00:46:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:46:45.176050 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64351cf-7326-4540-b188-ccf5dc7fd118 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:46:45.247248 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:46:45.363058 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64351cf-7326-4540-b188-ccf5dc7fd118 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:46:45.407746 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5084998-344c-4a46-9a5e-0f3b237e4c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:46:45.408432 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5084998-344c-4a46-9a5e-0f3b237e4c74 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:46:45.408708 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5084998-344c-4a46-9a5e-0f3b237e4c74 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:46:45.408980 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5084998-344c-4a46-9a5e-0f3b237e4c74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:46:45.424951 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5084998-344c-4a46-9a5e-0f3b237e4c74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:46:45.426751 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5084998-344c-4a46-9a5e-0f3b237e4c74 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:46:45.449444 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-c5084998-344c-4a46-9a5e-0f3b237e4c74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:46:45.449444 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:46:45.449444 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:46:45.449444 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:46:45.449444 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:46:45.449444 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:46:45.449444 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:46:45.449444 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:46:45.449444 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:46:45.449444 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:46:45.449444 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:46:45.449444 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:46:45.449444 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:46:45.449444 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:46:45.449444 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:46:45.449444 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:46:45.451146 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:46:45.451146 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:46:45.451146 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:46:45.451146 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:46:45.451146 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:46:45.451146 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:46:45.451146 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:46:45.451146 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:46:45.451146 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:46:45.451146 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:46:45.451146 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:46:45.451146 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:46:45.451146 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:46:45.451146 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:46:45.451146 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:46:45.451146 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:46:45.451146 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:46:45.453437 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:46:45.453437 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:46:45.453437 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:46:45.457216 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 595/1224] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:46:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:46:45.459003 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f963e8-0a4e-44e0-9d03-b1803ce0b631 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:46:45.613475 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f963e8-0a4e-44e0-9d03-b1803ce0b631 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:46:45.656378 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208fa820-7655-4c00-a5eb-a12c63681dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:46:45.657163 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208fa820-7655-4c00-a5eb-a12c63681dd4 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:46:45.657628 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208fa820-7655-4c00-a5eb-a12c63681dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:46:45.658104 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208fa820-7655-4c00-a5eb-a12c63681dd4 None admin] PATH_INFO: `/v3/domains` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:46:45.658883 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208fa820-7655-4c00-a5eb-a12c63681dd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:46:45.659420 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208fa820-7655-4c00-a5eb-a12c63681dd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:46:45.661549 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208fa820-7655-4c00-a5eb-a12c63681dd4 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:46:45.679001 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 630/1225] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:46:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:46:45.686234 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5084998-344c-4a46-9a5e-0f3b237e4c74 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:46:45.817536 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:46:45.825818 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5084998-344c-4a46-9a5e-0f3b237e4c74 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:46:45.866229 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3f2f4d-8ab4-4a64-96d0-7d8b6361d34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:46:45.867647 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f2f4d-8ab4-4a64-96d0-7d8b6361d34d None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:46:45.867972 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f2f4d-8ab4-4a64-96d0-7d8b6361d34d None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:46:45.868346 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f2f4d-8ab4-4a64-96d0-7d8b6361d34d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:46:45.881149 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3f2f4d-8ab4-4a64-96d0-7d8b6361d34d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:46:45.883651 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3f2f4d-8ab4-4a64-96d0-7d8b6361d34d None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:46:45.896398 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-5b3f2f4d-8ab4-4a64-96d0-7d8b6361d34d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 18 00:46:45.896398 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:46:45.896398 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:46:45.896398 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:46:45.896398 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:46:45.896398 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:46:45.896398 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:46:45.896398 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:46:45.896398 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:46:45.896398 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:46:45.896398 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:46:45.896398 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:46:45.896398 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 00:46:45.896398 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 00:46:45.896398 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 00:46:45.896398 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 00:46:45.898001 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:46:45.898001 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:46:45.898001 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 00:46:45.898001 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:46:45.898001 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 00:46:45.898001 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:46:45.898001 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:46:45.898001 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:46:45.898001 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:46:45.898001 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:46:45.898001 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:46:45.898001 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:46:45.898001 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:46:45.898001 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:46:45.898001 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:46:45.898001 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:46:45.898001 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:46:45.898001 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:46:45.899169 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:46:45.899169 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:46:45.899169 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 00:46:45.899169 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 00:46:45.899169 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 00:46:45.899169 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 00:46:45.899169 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 00:46:45.899169 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 00:46:45.899169 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 18 00:46:45.899169 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:46:45.899169 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 596/1226] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:46:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:46:45.905967 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208fa820-7655-4c00-a5eb-a12c63681dd4 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:46:45.989978 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:46:46.061355 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208fa820-7655-4c00-a5eb-a12c63681dd4 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:46:46.116309 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce5d832-aa86-4d86-9326-78f14c30ef5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:46:46.117338 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5d832-aa86-4d86-9326-78f14c30ef5e None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:46:46.117823 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5d832-aa86-4d86-9326-78f14c30ef5e None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:46:46.118269 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5d832-aa86-4d86-9326-78f14c30ef5e None admin] PATH_INFO: `/v3/users` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:46:46.119586 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce5d832-aa86-4d86-9326-78f14c30ef5e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:46:46.120136 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce5d832-aa86-4d86-9326-78f14c30ef5e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:46:46.122733 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce5d832-aa86-4d86-9326-78f14c30ef5e None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:46:46.156772 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 631/1227] 10.222.0.15 () {56 vars in 1143 bytes} [Sun Sep 18 00:46:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:46:46.158218 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3f2f4d-8ab4-4a64-96d0-7d8b6361d34d None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:46:46.283221 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3f2f4d-8ab4-4a64-96d0-7d8b6361d34d None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:46:46.327247 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57fd7e4-e072-474e-bd07-6b4aa21d5f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:46:46.328346 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57fd7e4-e072-474e-bd07-6b4aa21d5f19 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:46:46.328903 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57fd7e4-e072-474e-bd07-6b4aa21d5f19 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:46:46.329448 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57fd7e4-e072-474e-bd07-6b4aa21d5f19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:46:46.352768 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57fd7e4-e072-474e-bd07-6b4aa21d5f19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:46:46.354519 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57fd7e4-e072-474e-bd07-6b4aa21d5f19 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:46:46.373858 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-e57fd7e4-e072-474e-bd07-6b4aa21d5f19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:46:46.373858 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:46:46.373858 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:46:46.373858 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:46:46.373858 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:46:46.373858 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:46:46.373858 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:46:46.373858 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:46:46.373858 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:46:46.373858 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:46:46.373858 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:46:46.373858 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:46:46.373858 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:46:46.373858 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:46:46.373858 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:46:46.373858 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:46:46.376378 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:46:46.376378 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:46:46.376378 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:46:46.376378 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:46:46.376378 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:46:46.376378 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:46:46.376378 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:46:46.376378 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:46:46.376378 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:46:46.376378 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:46:46.376378 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:46:46.376378 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:46:46.376378 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:46:46.376378 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:46:46.376378 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:46:46.376378 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:46:46.376378 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:46:46.377315 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:46:46.377315 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:46:46.377315 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:46:46.377315 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 597/1228] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:46:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 00:46:46.385528 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce5d832-aa86-4d86-9326-78f14c30ef5e None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:46:46.526337 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce5d832-aa86-4d86-9326-78f14c30ef5e None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:46:46.529470 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:46:46.580476 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676b149b-aed8-432c-87cd-342f83815c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:46:46.581487 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b149b-aed8-432c-87cd-342f83815c6b None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:46:46.581992 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b149b-aed8-432c-87cd-342f83815c6b None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:46:46.582552 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b149b-aed8-432c-87cd-342f83815c6b None admin] PATH_INFO: `/v3/domains` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:46:46.583623 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676b149b-aed8-432c-87cd-342f83815c6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:46:46.584345 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676b149b-aed8-432c-87cd-342f83815c6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:46:46.586855 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676b149b-aed8-432c-87cd-342f83815c6b None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:46:46.602576 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 632/1229] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:46:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:46:46.610420 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57fd7e4-e072-474e-bd07-6b4aa21d5f19 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:46:46.626610 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:46:46.764111 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57fd7e4-e072-474e-bd07-6b4aa21d5f19 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:46:46.813269 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4cc39e-a51e-4d99-8d55-25e7fcbf41e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:46:46.814090 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4cc39e-a51e-4d99-8d55-25e7fcbf41e7 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:46:46.814419 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4cc39e-a51e-4d99-8d55-25e7fcbf41e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:46:46.814866 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4cc39e-a51e-4d99-8d55-25e7fcbf41e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:46:46.826079 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4cc39e-a51e-4d99-8d55-25e7fcbf41e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:46:46.827769 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4cc39e-a51e-4d99-8d55-25e7fcbf41e7 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:46:46.841431 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-5b4cc39e-a51e-4d99-8d55-25e7fcbf41e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:46:46.841431 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:46:46.841431 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:46:46.841431 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:46:46.841431 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:46:46.841431 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:46:46.841431 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:46:46.841431 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:46:46.841431 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:46:46.841431 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:46:46.841431 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:46:46.841431 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:46:46.841431 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 00:46:46.841431 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 00:46:46.841431 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 00:46:46.843182 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 00:46:46.843182 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:46:46.843182 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:46:46.843182 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:46:46.843182 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:46:46.843182 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:46:46.843182 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:46:46.843182 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:46:46.843182 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:46:46.843182 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:46:46.843182 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:46:46.843182 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:46:46.843182 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:46:46.843182 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:46:46.843182 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:46:46.843182 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:46:46.843182 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:46:46.844651 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 00:46:46.844651 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 00:46:46.844651 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 00:46:46.844651 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 00:46:46.844651 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 00:46:46.844651 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 00:46:46.844651 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:46:46.844651 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:46:46.844651 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 598/1230] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Sep 18 00:46:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:46:46.849587 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676b149b-aed8-432c-87cd-342f83815c6b None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:46:47.006502 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676b149b-aed8-432c-87cd-342f83815c6b None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:46:47.060864 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7954c4c-12b9-4ae7-858d-161d4225ff52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:46:47.061588 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7954c4c-12b9-4ae7-858d-161d4225ff52 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:46:47.061920 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7954c4c-12b9-4ae7-858d-161d4225ff52 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:46:47.062267 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7954c4c-12b9-4ae7-858d-161d4225ff52 None admin] PATH_INFO: `/v3/projects` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:46:47.063211 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7954c4c-12b9-4ae7-858d-161d4225ff52 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:46:47.063580 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7954c4c-12b9-4ae7-858d-161d4225ff52 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:46:47.065250 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7954c4c-12b9-4ae7-858d-161d4225ff52 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:46:47.081043 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 633/1231] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Sep 18 00:46:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:46:47.095126 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4cc39e-a51e-4d99-8d55-25e7fcbf41e7 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:46:47.185926 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:46:47.224693 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4cc39e-a51e-4d99-8d55-25e7fcbf41e7 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:46:47.268935 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2777c2-ce23-4e83-b53f-df8a8470c362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:46:47.269712 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2777c2-ce23-4e83-b53f-df8a8470c362 None admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:46:47.270000 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2777c2-ce23-4e83-b53f-df8a8470c362 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:46:47.270283 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2777c2-ce23-4e83-b53f-df8a8470c362 None admin] PATH_INFO: `/v3/projects/52ebde8fa3f84ede9ef575f7c0780798/users/7239e730ee034affb6bdf27e106c49cb/roles/5e91422b372b43749fe857ffd7bba774` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:46:47.291458 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2777c2-ce23-4e83-b53f-df8a8470c362 None admin] RBAC: Authorizing `identity:create_grant(project_id=52ebde8fa3f84ede9ef575f7c0780798, user_id=7239e730ee034affb6bdf27e106c49cb, role_id=5e91422b372b43749fe857ffd7bba774)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:46:47.293181 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2777c2-ce23-4e83-b53f-df8a8470c362 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:46:47.308541 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 599/1232] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Sep 18 00:46:47 2022] PUT /identity/v3/projects/52ebde8fa3f84ede9ef575f7c0780798/users/7239e730ee034affb6bdf27e106c49cb/roles/5e91422b372b43749fe857ffd7bba774 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 00:46:49.926121 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ccbd6-eb5d-48c1-979d-e0e3c029db42 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:46:49.926963 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ccbd6-eb5d-48c1-979d-e0e3c029db42 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:46:49.926963 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ccbd6-eb5d-48c1-979d-e0e3c029db42 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:46:49.928625 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 634/1233] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:46:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:46:49.936989 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba03da-71fb-4594-953f-ad77b43a3fa8 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:46:49.937505 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba03da-71fb-4594-953f-ad77b43a3fa8 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:46:49.937642 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba03da-71fb-4594-953f-ad77b43a3fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:46:49.963656 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-94ba03da-71fb-4594-953f-ad77b43a3fa8 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:46:49.965875 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-94ba03da-71fb-4594-953f-ad77b43a3fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:46:50.065878 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 600/1234] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:46:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 00:46:50.364533 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ccbd6-eb5d-48c1-979d-e0e3c029db42 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:46:50.399469 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:46:50.496836 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ccbd6-eb5d-48c1-979d-e0e3c029db42 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:46:50.557383 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9b9748-8c57-4d64-962a-80f483c5fb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:46:50.558279 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b9748-8c57-4d64-962a-80f483c5fb54 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:46:50.558718 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b9748-8c57-4d64-962a-80f483c5fb54 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:46:50.559504 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b9748-8c57-4d64-962a-80f483c5fb54 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:46:50.575567 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9b9748-8c57-4d64-962a-80f483c5fb54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:46:50.581660 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-8b9b9748-8c57-4d64-962a-80f483c5fb54 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 18 00:46:50.581660 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:46:50.581660 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:46:50.581660 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:46:50.581660 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:46:50.581660 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:46:50.581660 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:46:50.581660 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:46:50.581660 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:46:50.581660 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:46:50.581660 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:46:50.581660 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:46:50.581660 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:46:50.581660 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:46:50.581660 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:46:50.581660 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:46:50.582958 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:46:50.582958 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:46:50.582958 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:46:50.582958 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:46:50.582958 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:46:50.582958 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:46:50.582958 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:46:50.582958 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:46:50.582958 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:46:50.582958 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:46:50.582958 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:46:50.582958 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:46:50.582958 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:46:50.582958 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:46:50.582958 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:46:50.582958 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:46:50.584274 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:46:50.584274 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:46:50.584274 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:46:50.584274 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:46:50.584274 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:46:50.584274 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:46:50.584274 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:46:50.584274 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:46:50.584274 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:46:50.584274 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:46:50.584274 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 18 00:46:50.584274 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:46:50.584274 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 635/1235] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Sep 18 00:46:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:46:50.591244 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba03da-71fb-4594-953f-ad77b43a3fa8 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:46:50.644947 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:46:50.723380 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba03da-71fb-4594-953f-ad77b43a3fa8 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:46:50.777439 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b060b8ca-0b62-459f-993c-d68534149728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:46:50.778125 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060b8ca-0b62-459f-993c-d68534149728 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:46:50.778361 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060b8ca-0b62-459f-993c-d68534149728 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:46:50.778641 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060b8ca-0b62-459f-993c-d68534149728 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:46:50.779395 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b060b8ca-0b62-459f-993c-d68534149728 None admin] RBAC: Adding query filter params (name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:46:50.779654 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b060b8ca-0b62-459f-993c-d68534149728 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:46:50.781093 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b060b8ca-0b62-459f-993c-d68534149728 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:46:50.791313 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 601/1236] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Sep 18 00:46:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:46:50.797453 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9b9748-8c57-4d64-962a-80f483c5fb54 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:46:50.920664 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:46:50.945047 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9b9748-8c57-4d64-962a-80f483c5fb54 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:46:51.000888 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d838bf7-34b8-4df5-ba5f-91320aa8cc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:46:51.001868 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d838bf7-34b8-4df5-ba5f-91320aa8cc5d None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:46:51.002435 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d838bf7-34b8-4df5-ba5f-91320aa8cc5d None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:46:51.002970 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d838bf7-34b8-4df5-ba5f-91320aa8cc5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:46:51.028506 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d838bf7-34b8-4df5-ba5f-91320aa8cc5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:46:51.031681 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d838bf7-34b8-4df5-ba5f-91320aa8cc5d None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:46:51.058645 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-5d838bf7-34b8-4df5-ba5f-91320aa8cc5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:46:51.058645 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:46:51.058645 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:46:51.058645 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:46:51.058645 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:46:51.058645 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:46:51.058645 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:46:51.058645 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:46:51.058645 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:46:51.058645 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:46:51.058645 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:46:51.058645 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:46:51.058645 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:46:51.058645 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:46:51.058645 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:46:51.058645 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:46:51.059984 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:46:51.059984 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:46:51.059984 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:46:51.059984 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:46:51.059984 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:46:51.059984 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:46:51.059984 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:46:51.059984 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:46:51.059984 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:46:51.059984 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:46:51.059984 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:46:51.059984 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:46:51.059984 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:46:51.059984 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:46:51.059984 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:46:51.059984 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:46:51.059984 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:46:51.061367 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:46:51.061367 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:46:51.061367 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:46:51.063054 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 636/1237] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:46:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:46:51.071557 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b060b8ca-0b62-459f-993c-d68534149728 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:46:51.199050 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b060b8ca-0b62-459f-993c-d68534149728 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:46:51.209483 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:46:51.243269 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2ce3d5-c65d-47fc-aef9-0f255b8a68f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:46:51.243973 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ce3d5-c65d-47fc-aef9-0f255b8a68f6 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:46:51.244338 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ce3d5-c65d-47fc-aef9-0f255b8a68f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:46:51.244706 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ce3d5-c65d-47fc-aef9-0f255b8a68f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:46:51.245474 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2ce3d5-c65d-47fc-aef9-0f255b8a68f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:46:51.245884 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2ce3d5-c65d-47fc-aef9-0f255b8a68f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:46:51.247280 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2ce3d5-c65d-47fc-aef9-0f255b8a68f6 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:46:51.262635 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 602/1238] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:46:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:46:51.269402 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d838bf7-34b8-4df5-ba5f-91320aa8cc5d None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:46:51.409917 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d838bf7-34b8-4df5-ba5f-91320aa8cc5d None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:46:51.458537 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1146a7-bfde-4a8f-aaee-fbdef252903f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:46:51.459222 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1146a7-bfde-4a8f-aaee-fbdef252903f None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:46:51.459510 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1146a7-bfde-4a8f-aaee-fbdef252903f None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:46:51.459828 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1146a7-bfde-4a8f-aaee-fbdef252903f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:46:51.464394 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:46:51.471683 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1146a7-bfde-4a8f-aaee-fbdef252903f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:46:51.474517 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1146a7-bfde-4a8f-aaee-fbdef252903f None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:46:51.488734 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-ab1146a7-bfde-4a8f-aaee-fbdef252903f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 18 00:46:51.488734 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:46:51.488734 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:46:51.488734 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:46:51.488734 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:46:51.488734 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:46:51.488734 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:46:51.488734 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:46:51.488734 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:46:51.488734 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:46:51.488734 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:46:51.488734 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:46:51.488734 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 00:46:51.488734 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 00:46:51.488734 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 00:46:51.488734 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 00:46:51.490096 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:46:51.490096 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:46:51.490096 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 00:46:51.490096 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:46:51.490096 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 00:46:51.490096 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:46:51.490096 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:46:51.490096 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:46:51.490096 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:46:51.490096 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:46:51.490096 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:46:51.490096 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:46:51.490096 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:46:51.490096 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:46:51.490096 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:46:51.490096 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:46:51.490096 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:46:51.490096 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:46:51.491397 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:46:51.491397 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:46:51.491397 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 00:46:51.491397 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 00:46:51.491397 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 00:46:51.491397 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 00:46:51.491397 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 00:46:51.491397 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 00:46:51.491397 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 18 00:46:51.491397 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:46:51.491397 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 637/1239] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:46:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 00:46:51.500714 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2ce3d5-c65d-47fc-aef9-0f255b8a68f6 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:46:51.654589 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2ce3d5-c65d-47fc-aef9-0f255b8a68f6 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:46:51.701942 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241acfe2-8e25-44c8-86e9-38569236e529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:46:51.702574 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241acfe2-8e25-44c8-86e9-38569236e529 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:46:51.702853 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241acfe2-8e25-44c8-86e9-38569236e529 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:46:51.703125 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241acfe2-8e25-44c8-86e9-38569236e529 None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:46:51.703857 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241acfe2-8e25-44c8-86e9-38569236e529 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:46:51.704201 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241acfe2-8e25-44c8-86e9-38569236e529 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:46:51.705647 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241acfe2-8e25-44c8-86e9-38569236e529 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:46:51.726104 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 603/1240] 10.222.0.15 () {56 vars in 1143 bytes} [Sun Sep 18 00:46:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:46:51.734643 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1146a7-bfde-4a8f-aaee-fbdef252903f None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:46:51.917239 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1146a7-bfde-4a8f-aaee-fbdef252903f None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:46:51.998519 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2821ca75-143d-4c56-954e-ddbd3213884b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:46:51.999175 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2821ca75-143d-4c56-954e-ddbd3213884b None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:46:51.999451 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2821ca75-143d-4c56-954e-ddbd3213884b None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:46:51.999714 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2821ca75-143d-4c56-954e-ddbd3213884b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:46:52.096791 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:46:52.106559 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2821ca75-143d-4c56-954e-ddbd3213884b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:46:52.108374 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2821ca75-143d-4c56-954e-ddbd3213884b None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:46:52.219680 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 638/1241] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Sep 18 00:46:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 18 00:46:52.226564 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241acfe2-8e25-44c8-86e9-38569236e529 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:46:52.258979 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:46:52.367752 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241acfe2-8e25-44c8-86e9-38569236e529 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:46:52.421798 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2483eb4e-ea17-4c45-b251-f0adce239575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:46:52.422859 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483eb4e-ea17-4c45-b251-f0adce239575 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:46:52.423353 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483eb4e-ea17-4c45-b251-f0adce239575 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:46:52.423850 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483eb4e-ea17-4c45-b251-f0adce239575 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:46:52.440516 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2483eb4e-ea17-4c45-b251-f0adce239575 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:46:52.442708 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2483eb4e-ea17-4c45-b251-f0adce239575 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:46:52.462710 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-2483eb4e-ea17-4c45-b251-f0adce239575 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:46:52.462710 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:46:52.462710 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:46:52.462710 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:46:52.462710 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:46:52.462710 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:46:52.462710 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:46:52.462710 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:46:52.462710 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:46:52.462710 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:46:52.462710 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:46:52.462710 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:46:52.462710 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:46:52.462710 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:46:52.462710 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:46:52.462710 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:46:52.463908 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:46:52.463908 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:46:52.463908 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:46:52.463908 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:46:52.463908 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:46:52.463908 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:46:52.463908 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:46:52.463908 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:46:52.463908 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:46:52.463908 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:46:52.463908 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:46:52.463908 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:46:52.463908 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:46:52.463908 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:46:52.463908 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:46:52.463908 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:46:52.463908 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:46:52.464840 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:46:52.464840 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:46:52.464840 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:46:52.464840 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 604/1242] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:46:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:46:52.472360 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2821ca75-143d-4c56-954e-ddbd3213884b None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:46:52.594539 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:46:52.601684 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2821ca75-143d-4c56-954e-ddbd3213884b None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:46:52.658070 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0e81a-ec09-49f0-b752-b1fa5711470b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:46:52.658781 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0e81a-ec09-49f0-b752-b1fa5711470b None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:46:52.659118 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0e81a-ec09-49f0-b752-b1fa5711470b None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:46:52.659453 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0e81a-ec09-49f0-b752-b1fa5711470b None admin] PATH_INFO: `/v3/domains` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:46:52.660236 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd0e81a-ec09-49f0-b752-b1fa5711470b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:46:52.660597 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd0e81a-ec09-49f0-b752-b1fa5711470b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:46:52.662040 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd0e81a-ec09-49f0-b752-b1fa5711470b None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:46:52.675923 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 639/1243] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:46:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:46:52.681750 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2483eb4e-ea17-4c45-b251-f0adce239575 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:46:52.785562 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:46:52.816445 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2483eb4e-ea17-4c45-b251-f0adce239575 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:46:52.857898 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a5b32-12e1-4fe8-96ff-23aa53f62109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:46:52.858472 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a5b32-12e1-4fe8-96ff-23aa53f62109 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:46:52.858755 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a5b32-12e1-4fe8-96ff-23aa53f62109 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:46:52.859080 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a5b32-12e1-4fe8-96ff-23aa53f62109 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:46:52.867555 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4a5b32-12e1-4fe8-96ff-23aa53f62109 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:46:52.869146 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4a5b32-12e1-4fe8-96ff-23aa53f62109 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:46:52.882340 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-4c4a5b32-12e1-4fe8-96ff-23aa53f62109 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:46:52.882340 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:46:52.882340 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:46:52.882340 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:46:52.882340 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:46:52.882340 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:46:52.882340 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:46:52.882340 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:46:52.882340 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:46:52.882340 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:46:52.882340 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:46:52.882340 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:46:52.882340 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 00:46:52.882340 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 00:46:52.882340 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 00:46:52.883521 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 00:46:52.883521 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:46:52.883521 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:46:52.883521 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:46:52.883521 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:46:52.883521 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:46:52.883521 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:46:52.883521 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:46:52.883521 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:46:52.883521 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:46:52.883521 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:46:52.883521 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:46:52.883521 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:46:52.883521 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:46:52.883521 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:46:52.883521 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:46:52.883521 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:46:52.884563 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 00:46:52.884563 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 00:46:52.884563 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 00:46:52.884563 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 00:46:52.884563 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 00:46:52.884563 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 00:46:52.884563 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:46:52.884563 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:46:52.884563 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 605/1244] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Sep 18 00:46:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:46:52.890730 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0e81a-ec09-49f0-b752-b1fa5711470b None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:46:53.047706 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0e81a-ec09-49f0-b752-b1fa5711470b None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:46:53.094473 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44917a93-2167-4e7f-b1df-51e9dd8d2a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:46:53.095175 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44917a93-2167-4e7f-b1df-51e9dd8d2a83 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:46:53.095429 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44917a93-2167-4e7f-b1df-51e9dd8d2a83 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:46:53.095701 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44917a93-2167-4e7f-b1df-51e9dd8d2a83 None admin] PATH_INFO: `/v3/projects` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:46:53.096398 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44917a93-2167-4e7f-b1df-51e9dd8d2a83 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:46:53.096967 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44917a93-2167-4e7f-b1df-51e9dd8d2a83 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:46:53.098118 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44917a93-2167-4e7f-b1df-51e9dd8d2a83 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:46:53.118764 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 640/1245] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Sep 18 00:46:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:46:53.125754 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a5b32-12e1-4fe8-96ff-23aa53f62109 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:46:53.271484 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a5b32-12e1-4fe8-96ff-23aa53f62109 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:46:53.332143 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47274d6a-c485-4750-8ced-0bb3d9b0ce20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:46:53.332984 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47274d6a-c485-4750-8ced-0bb3d9b0ce20 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:46:53.333420 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47274d6a-c485-4750-8ced-0bb3d9b0ce20 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:46:53.333829 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47274d6a-c485-4750-8ced-0bb3d9b0ce20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:46:53.334785 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47274d6a-c485-4750-8ced-0bb3d9b0ce20 None admin] RBAC: Adding query filter params (role.id=5e91422b372b43749fe857ffd7bba774, scope.project.id=52ebde8fa3f84ede9ef575f7c0780798, user.id=7239e730ee034affb6bdf27e106c49cb) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:46:53.335150 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47274d6a-c485-4750-8ced-0bb3d9b0ce20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:46:53.337821 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47274d6a-c485-4750-8ced-0bb3d9b0ce20 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:46:53.346101 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 606/1246] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Sep 18 00:46:53 2022] GET /identity/v3/role_assignments?user.id=7239e730ee034affb6bdf27e106c49cb&scope.project.id=52ebde8fa3f84ede9ef575f7c0780798&role.id=5e91422b372b43749fe857ffd7bba774 => generated 608 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:46:56.026191 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf67e14-05c8-43d0-82d7-87c2b8a44fd9 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:46:56.027073 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf67e14-05c8-43d0-82d7-87c2b8a44fd9 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:46:56.027243 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf67e14-05c8-43d0-82d7-87c2b8a44fd9 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:46:56.029902 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 641/1247] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:46:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:46:56.044616 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a9c3d-aa56-46f3-86b1-f04ac45ce36e None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:46:56.045170 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a9c3d-aa56-46f3-86b1-f04ac45ce36e None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:46:56.045801 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a9c3d-aa56-46f3-86b1-f04ac45ce36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:46:56.060284 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:46:56.086460 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-949a9c3d-aa56-46f3-86b1-f04ac45ce36e None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:46:56.088587 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-949a9c3d-aa56-46f3-86b1-f04ac45ce36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:46:56.208709 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 607/1248] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:46:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 00:46:56.525577 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf67e14-05c8-43d0-82d7-87c2b8a44fd9 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:46:56.555651 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:46:56.684560 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf67e14-05c8-43d0-82d7-87c2b8a44fd9 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:46:56.735155 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b2dda8-7d11-4fb5-bd97-273b5048b464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:46:56.735769 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2dda8-7d11-4fb5-bd97-273b5048b464 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:46:56.736175 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2dda8-7d11-4fb5-bd97-273b5048b464 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:46:56.736453 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2dda8-7d11-4fb5-bd97-273b5048b464 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:46:56.751265 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b2dda8-7d11-4fb5-bd97-273b5048b464 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:46:56.756104 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-30b2dda8-7d11-4fb5-bd97-273b5048b464 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 00:46:56.756104 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:46:56.756104 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:46:56.756104 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:46:56.756104 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:46:56.756104 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:46:56.756104 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:46:56.756104 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:46:56.756104 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:46:56.756104 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:46:56.756104 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:46:56.756104 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:46:56.756104 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:46:56.756104 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:46:56.756104 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:46:56.756104 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:46:56.757265 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:46:56.757265 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:46:56.757265 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:46:56.757265 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:46:56.757265 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:46:56.757265 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:46:56.757265 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:46:56.757265 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:46:56.757265 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:46:56.757265 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:46:56.757265 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:46:56.757265 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:46:56.757265 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:46:56.757265 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:46:56.757265 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:46:56.757265 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:46:56.758121 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:46:56.758121 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:46:56.758121 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:46:56.758121 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:46:56.758121 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:46:56.758121 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:46:56.758121 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:46:56.758121 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:46:56.758121 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:46:56.758121 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:46:56.758121 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 00:46:56.758121 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:46:56.758121 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 642/1249] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Sep 18 00:46:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 00:46:56.764271 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949a9c3d-aa56-46f3-86b1-f04ac45ce36e None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:46:56.923955 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949a9c3d-aa56-46f3-86b1-f04ac45ce36e None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:46:56.978460 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:46:56.988877 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f6a22-70a1-4664-84eb-2924eee295bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:46:56.989832 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f6a22-70a1-4664-84eb-2924eee295bb None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:46:56.990326 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f6a22-70a1-4664-84eb-2924eee295bb None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:46:56.990814 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f6a22-70a1-4664-84eb-2924eee295bb None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:46:56.991817 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97f6a22-70a1-4664-84eb-2924eee295bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:46:56.992254 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97f6a22-70a1-4664-84eb-2924eee295bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:46:56.994339 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97f6a22-70a1-4664-84eb-2924eee295bb None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:46:57.008988 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 608/1250] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Sep 18 00:46:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:46:57.017064 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b2dda8-7d11-4fb5-bd97-273b5048b464 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:46:57.140737 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:46:57.183051 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b2dda8-7d11-4fb5-bd97-273b5048b464 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:46:57.226779 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a769271-6654-432b-b258-2bf51a8b4327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:46:57.227572 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a769271-6654-432b-b258-2bf51a8b4327 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:46:57.227841 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a769271-6654-432b-b258-2bf51a8b4327 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:46:57.228140 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a769271-6654-432b-b258-2bf51a8b4327 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:46:57.242505 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a769271-6654-432b-b258-2bf51a8b4327 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:46:57.244645 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a769271-6654-432b-b258-2bf51a8b4327 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:46:57.268296 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-0a769271-6654-432b-b258-2bf51a8b4327 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:46:57.268296 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:46:57.268296 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:46:57.268296 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:46:57.268296 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:46:57.268296 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:46:57.268296 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:46:57.268296 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:46:57.268296 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:46:57.268296 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:46:57.268296 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:46:57.268296 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:46:57.268296 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:46:57.268296 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:46:57.268296 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:46:57.268296 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:46:57.269563 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:46:57.269563 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:46:57.269563 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:46:57.269563 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:46:57.269563 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:46:57.269563 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:46:57.269563 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:46:57.269563 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:46:57.269563 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:46:57.269563 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:46:57.269563 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:46:57.269563 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:46:57.269563 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:46:57.269563 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:46:57.269563 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:46:57.269563 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:46:57.269563 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:46:57.270609 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:46:57.270609 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:46:57.270609 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:46:57.270609 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 643/1251] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:46:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 00:46:57.276489 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f6a22-70a1-4664-84eb-2924eee295bb None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:46:57.414752 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f6a22-70a1-4664-84eb-2924eee295bb None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:46:57.452539 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bf35fa-1acb-4db2-a453-9b47a1007d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:46:57.453059 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf35fa-1acb-4db2-a453-9b47a1007d72 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:46:57.453386 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf35fa-1acb-4db2-a453-9b47a1007d72 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:46:57.453656 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf35fa-1acb-4db2-a453-9b47a1007d72 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:46:57.454312 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bf35fa-1acb-4db2-a453-9b47a1007d72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:46:57.454613 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bf35fa-1acb-4db2-a453-9b47a1007d72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:46:57.456036 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bf35fa-1acb-4db2-a453-9b47a1007d72 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:46:57.472941 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 609/1252] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:46:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:46:57.481439 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a769271-6654-432b-b258-2bf51a8b4327 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:46:57.640829 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a769271-6654-432b-b258-2bf51a8b4327 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:46:57.676745 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:46:57.690883 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cafcb5c-c9fe-4bec-a952-3e87c4a87678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:46:57.692065 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cafcb5c-c9fe-4bec-a952-3e87c4a87678 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:46:57.692727 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cafcb5c-c9fe-4bec-a952-3e87c4a87678 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:46:57.693092 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cafcb5c-c9fe-4bec-a952-3e87c4a87678 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:46:57.704187 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cafcb5c-c9fe-4bec-a952-3e87c4a87678 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:46:57.705710 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cafcb5c-c9fe-4bec-a952-3e87c4a87678 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:46:57.717843 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-4cafcb5c-c9fe-4bec-a952-3e87c4a87678 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 18 00:46:57.717843 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:46:57.717843 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:46:57.717843 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:46:57.717843 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:46:57.717843 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:46:57.717843 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:46:57.717843 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:46:57.717843 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:46:57.717843 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:46:57.717843 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:46:57.717843 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:46:57.717843 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 00:46:57.717843 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 00:46:57.717843 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 00:46:57.717843 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 00:46:57.719231 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:46:57.719231 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:46:57.719231 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 00:46:57.719231 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:46:57.719231 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 00:46:57.719231 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:46:57.719231 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:46:57.719231 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:46:57.719231 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:46:57.719231 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:46:57.719231 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:46:57.719231 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:46:57.719231 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:46:57.719231 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:46:57.719231 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:46:57.719231 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:46:57.719231 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:46:57.719231 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:46:57.720465 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:46:57.720465 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:46:57.720465 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 00:46:57.720465 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 00:46:57.720465 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 00:46:57.720465 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 00:46:57.720465 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 00:46:57.720465 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 00:46:57.720465 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 18 00:46:57.720465 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:46:57.720465 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 644/1253] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:46:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:46:57.729155 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bf35fa-1acb-4db2-a453-9b47a1007d72 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:46:57.824657 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:46:57.881717 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bf35fa-1acb-4db2-a453-9b47a1007d72 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:46:57.923239 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb76dd0-7bf8-4dcd-bf14-545d8710b0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:46:57.923968 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb76dd0-7bf8-4dcd-bf14-545d8710b0e5 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:46:57.924193 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb76dd0-7bf8-4dcd-bf14-545d8710b0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:46:57.924457 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb76dd0-7bf8-4dcd-bf14-545d8710b0e5 None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:46:57.925191 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb76dd0-7bf8-4dcd-bf14-545d8710b0e5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:46:57.925493 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb76dd0-7bf8-4dcd-bf14-545d8710b0e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:46:57.926930 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb76dd0-7bf8-4dcd-bf14-545d8710b0e5 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:46:57.961653 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 610/1254] 10.222.0.15 () {56 vars in 1143 bytes} [Sun Sep 18 00:46:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:46:57.963089 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cafcb5c-c9fe-4bec-a952-3e87c4a87678 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:46:58.144803 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cafcb5c-c9fe-4bec-a952-3e87c4a87678 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:46:58.187110 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8dbd75-a8ad-49c7-b598-6fd0682f855c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:46:58.187675 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8dbd75-a8ad-49c7-b598-6fd0682f855c None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:46:58.188132 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8dbd75-a8ad-49c7-b598-6fd0682f855c None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:46:58.188628 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8dbd75-a8ad-49c7-b598-6fd0682f855c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:46:58.274103 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:46:58.288613 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8dbd75-a8ad-49c7-b598-6fd0682f855c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:46:58.290343 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8dbd75-a8ad-49c7-b598-6fd0682f855c None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:46:58.433852 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 645/1255] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Sep 18 00:46:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 18 00:46:58.435825 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb76dd0-7bf8-4dcd-bf14-545d8710b0e5 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:46:58.560115 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb76dd0-7bf8-4dcd-bf14-545d8710b0e5 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:46:58.577840 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:46:58.606951 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec666f84-9aa5-4bdb-ab23-3313c90e158b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:46:58.607753 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec666f84-9aa5-4bdb-ab23-3313c90e158b None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:46:58.608062 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec666f84-9aa5-4bdb-ab23-3313c90e158b None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:46:58.608374 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec666f84-9aa5-4bdb-ab23-3313c90e158b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:46:58.623262 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec666f84-9aa5-4bdb-ab23-3313c90e158b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:46:58.625146 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec666f84-9aa5-4bdb-ab23-3313c90e158b None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:46:58.646907 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-ec666f84-9aa5-4bdb-ab23-3313c90e158b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:46:58.646907 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:46:58.646907 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:46:58.646907 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:46:58.646907 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:46:58.646907 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:46:58.646907 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:46:58.646907 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:46:58.646907 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:46:58.646907 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:46:58.646907 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:46:58.646907 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:46:58.646907 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:46:58.646907 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:46:58.646907 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:46:58.646907 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:46:58.648623 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:46:58.648623 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:46:58.648623 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:46:58.648623 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:46:58.648623 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:46:58.648623 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:46:58.648623 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:46:58.648623 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:46:58.648623 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:46:58.648623 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:46:58.648623 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:46:58.648623 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:46:58.648623 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:46:58.648623 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:46:58.648623 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:46:58.648623 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:46:58.648623 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:46:58.650536 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:46:58.650536 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:46:58.650536 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:46:58.651294 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 611/1256] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:46:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 00:46:58.656160 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8dbd75-a8ad-49c7-b598-6fd0682f855c None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:46:58.775410 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:46:58.802865 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8dbd75-a8ad-49c7-b598-6fd0682f855c None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:46:58.850363 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8749d5-4295-4d3e-a7ac-00b829ba96ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:46:58.850998 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8749d5-4295-4d3e-a7ac-00b829ba96ff None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:46:58.851281 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8749d5-4295-4d3e-a7ac-00b829ba96ff None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:46:58.851562 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8749d5-4295-4d3e-a7ac-00b829ba96ff None admin] PATH_INFO: `/v3/domains` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:46:58.852289 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8749d5-4295-4d3e-a7ac-00b829ba96ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:46:58.852596 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8749d5-4295-4d3e-a7ac-00b829ba96ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:46:58.854031 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8749d5-4295-4d3e-a7ac-00b829ba96ff None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:46:58.871448 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 646/1257] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:46:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:46:58.877585 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec666f84-9aa5-4bdb-ab23-3313c90e158b None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:46:59.028386 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec666f84-9aa5-4bdb-ab23-3313c90e158b None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:46:59.068082 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ec523-3f05-4241-8e35-211bca341d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:46:59.069275 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ec523-3f05-4241-8e35-211bca341d6f None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:46:59.069550 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ec523-3f05-4241-8e35-211bca341d6f None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:46:59.069820 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ec523-3f05-4241-8e35-211bca341d6f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:46:59.077298 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68ec523-3f05-4241-8e35-211bca341d6f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:46:59.078765 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68ec523-3f05-4241-8e35-211bca341d6f None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:46:59.091754 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-b68ec523-3f05-4241-8e35-211bca341d6f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:46:59.091754 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:46:59.091754 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:46:59.091754 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:46:59.091754 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:46:59.091754 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:46:59.091754 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:46:59.091754 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:46:59.091754 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:46:59.091754 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:46:59.091754 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:46:59.091754 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:46:59.091754 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 00:46:59.091754 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 00:46:59.091754 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 00:46:59.092919 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 00:46:59.092919 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:46:59.092919 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:46:59.092919 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:46:59.092919 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:46:59.092919 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:46:59.092919 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:46:59.092919 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:46:59.092919 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:46:59.092919 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:46:59.092919 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:46:59.092919 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:46:59.092919 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:46:59.092919 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:46:59.092919 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:46:59.092919 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:46:59.092919 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:46:59.094217 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 00:46:59.094217 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 00:46:59.094217 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 00:46:59.094217 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 00:46:59.094217 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 00:46:59.094217 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 00:46:59.094217 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:46:59.094217 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:46:59.094217 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 612/1258] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Sep 18 00:46:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:46:59.099408 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8749d5-4295-4d3e-a7ac-00b829ba96ff None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:46:59.236542 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8749d5-4295-4d3e-a7ac-00b829ba96ff None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:46:59.282899 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b46a2c7-5b92-45a3-8ecc-830c46195492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:46:59.283447 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46a2c7-5b92-45a3-8ecc-830c46195492 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:46:59.283737 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46a2c7-5b92-45a3-8ecc-830c46195492 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:46:59.284040 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46a2c7-5b92-45a3-8ecc-830c46195492 None admin] PATH_INFO: `/v3/projects` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:46:59.284797 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b46a2c7-5b92-45a3-8ecc-830c46195492 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:46:59.285105 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b46a2c7-5b92-45a3-8ecc-830c46195492 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:46:59.286545 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b46a2c7-5b92-45a3-8ecc-830c46195492 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:46:59.304363 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 647/1259] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Sep 18 00:46:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:46:59.311606 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ec523-3f05-4241-8e35-211bca341d6f None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:46:59.350202 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:46:59.440047 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ec523-3f05-4241-8e35-211bca341d6f None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:46:59.479638 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab6d29b-30f0-4fc8-bfd8-2c250285fb7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:46:59.480302 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6d29b-30f0-4fc8-bfd8-2c250285fb7e None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:46:59.480583 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6d29b-30f0-4fc8-bfd8-2c250285fb7e None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:46:59.480859 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6d29b-30f0-4fc8-bfd8-2c250285fb7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:46:59.481594 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab6d29b-30f0-4fc8-bfd8-2c250285fb7e None admin] RBAC: Adding query filter params (role.id=591d4711dc204cf98003c8b7d7558506, scope.project.id=52ebde8fa3f84ede9ef575f7c0780798, user.id=7239e730ee034affb6bdf27e106c49cb) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:46:59.481904 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab6d29b-30f0-4fc8-bfd8-2c250285fb7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:46:59.483360 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab6d29b-30f0-4fc8-bfd8-2c250285fb7e None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:46:59.489898 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 613/1260] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Sep 18 00:46:59 2022] GET /identity/v3/role_assignments?user.id=7239e730ee034affb6bdf27e106c49cb&scope.project.id=52ebde8fa3f84ede9ef575f7c0780798&role.id=591d4711dc204cf98003c8b7d7558506 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:47:01.902865 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade32eb-c1d4-408a-80ba-83b98cda3797 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:47:01.903445 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade32eb-c1d4-408a-80ba-83b98cda3797 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:47:01.903445 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade32eb-c1d4-408a-80ba-83b98cda3797 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:47:01.904955 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 648/1261] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:47:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:47:01.911025 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce432e-a848-4fd3-a035-b9ba271228e4 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:47:01.911595 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce432e-a848-4fd3-a035-b9ba271228e4 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:47:01.912009 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce432e-a848-4fd3-a035-b9ba271228e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:47:01.935780 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-6cce432e-a848-4fd3-a035-b9ba271228e4 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:47:01.937129 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-6cce432e-a848-4fd3-a035-b9ba271228e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:47:02.039952 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 614/1262] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:47:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 00:47:02.332547 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ade32eb-c1d4-408a-80ba-83b98cda3797 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:47:02.345431 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:47:02.458905 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ade32eb-c1d4-408a-80ba-83b98cda3797 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:47:02.499041 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4271d645-57c0-4f12-8a46-27f2c5bc3c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:47:02.499784 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4271d645-57c0-4f12-8a46-27f2c5bc3c44 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:47:02.500164 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4271d645-57c0-4f12-8a46-27f2c5bc3c44 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:47:02.500475 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4271d645-57c0-4f12-8a46-27f2c5bc3c44 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:47:02.512048 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4271d645-57c0-4f12-8a46-27f2c5bc3c44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:47:02.516908 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-4271d645-57c0-4f12-8a46-27f2c5bc3c44 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 00:47:02.516908 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:47:02.516908 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:47:02.516908 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:47:02.516908 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:47:02.516908 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:47:02.516908 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:47:02.516908 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:47:02.516908 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:47:02.516908 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:47:02.516908 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:47:02.516908 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:47:02.516908 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:47:02.516908 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:47:02.516908 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:47:02.516908 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:47:02.517979 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:47:02.517979 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:47:02.517979 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:47:02.517979 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:47:02.517979 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:47:02.517979 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:47:02.517979 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:47:02.517979 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:47:02.517979 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:47:02.517979 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:47:02.517979 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:47:02.517979 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:47:02.517979 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:47:02.517979 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:47:02.517979 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:47:02.517979 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:47:02.518842 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:47:02.518842 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:47:02.518842 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:47:02.518842 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:47:02.518842 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:47:02.518842 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:47:02.518842 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:47:02.518842 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:47:02.518842 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:47:02.518842 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:47:02.518842 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 00:47:02.518842 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:47:02.518842 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 649/1263] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Sep 18 00:47:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:47:02.525516 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce432e-a848-4fd3-a035-b9ba271228e4 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:47:02.547257 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:47:02.644073 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce432e-a848-4fd3-a035-b9ba271228e4 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:47:02.684525 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa970bc-d852-49fd-8e8a-09555492e132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:47:02.685378 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa970bc-d852-49fd-8e8a-09555492e132 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:47:02.685684 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa970bc-d852-49fd-8e8a-09555492e132 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:47:02.686012 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa970bc-d852-49fd-8e8a-09555492e132 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:47:02.686737 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa970bc-d852-49fd-8e8a-09555492e132 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:47:02.687133 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa970bc-d852-49fd-8e8a-09555492e132 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:47:02.688799 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa970bc-d852-49fd-8e8a-09555492e132 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:47:02.699994 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 615/1264] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Sep 18 00:47:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:47:02.705801 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4271d645-57c0-4f12-8a46-27f2c5bc3c44 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:47:02.777473 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:47:02.813254 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4271d645-57c0-4f12-8a46-27f2c5bc3c44 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:47:02.849344 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c6353-3419-4063-b569-d5011dfcd2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:47:02.850479 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c6353-3419-4063-b569-d5011dfcd2e3 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:47:02.850758 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c6353-3419-4063-b569-d5011dfcd2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:47:02.851029 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c6353-3419-4063-b569-d5011dfcd2e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:47:02.862456 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7c6353-3419-4063-b569-d5011dfcd2e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:47:02.863945 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7c6353-3419-4063-b569-d5011dfcd2e3 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:47:02.880062 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-4e7c6353-3419-4063-b569-d5011dfcd2e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:47:02.880062 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:47:02.880062 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:47:02.880062 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:47:02.880062 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:47:02.880062 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:47:02.880062 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:47:02.880062 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:47:02.880062 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:47:02.880062 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:47:02.880062 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:47:02.880062 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:47:02.880062 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:47:02.880062 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:47:02.880062 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:47:02.880062 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:47:02.881494 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:47:02.881494 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:47:02.881494 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:47:02.881494 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:47:02.881494 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:47:02.881494 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:47:02.881494 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:47:02.881494 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:47:02.881494 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:47:02.881494 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:47:02.881494 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:47:02.881494 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:47:02.881494 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:47:02.881494 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:47:02.881494 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:47:02.881494 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:47:02.881494 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:47:02.883245 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:47:02.883245 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:47:02.883245 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:47:02.883245 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 650/1265] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:47:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 00:47:02.887403 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa970bc-d852-49fd-8e8a-09555492e132 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:47:02.998091 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:47:03.026111 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa970bc-d852-49fd-8e8a-09555492e132 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:47:03.066025 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da70c5b8-65f8-485c-bac2-2a88a7e994a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:47:03.066659 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70c5b8-65f8-485c-bac2-2a88a7e994a5 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:47:03.066949 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70c5b8-65f8-485c-bac2-2a88a7e994a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:47:03.067224 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70c5b8-65f8-485c-bac2-2a88a7e994a5 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:47:03.067926 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da70c5b8-65f8-485c-bac2-2a88a7e994a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:47:03.068237 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da70c5b8-65f8-485c-bac2-2a88a7e994a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:47:03.069710 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da70c5b8-65f8-485c-bac2-2a88a7e994a5 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:47:03.083253 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 616/1266] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:47:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:47:03.092507 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c6353-3419-4063-b569-d5011dfcd2e3 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:47:03.202758 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c6353-3419-4063-b569-d5011dfcd2e3 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:47:03.228036 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:47:03.243549 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed2c19-2914-4e38-9fd0-09e2284d06eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:47:03.244233 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed2c19-2914-4e38-9fd0-09e2284d06eb None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:47:03.244522 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed2c19-2914-4e38-9fd0-09e2284d06eb None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:47:03.244791 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed2c19-2914-4e38-9fd0-09e2284d06eb None admin] PATH_INFO: `/v3/users/placement` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:47:03.253804 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fed2c19-2914-4e38-9fd0-09e2284d06eb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:47:03.255460 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fed2c19-2914-4e38-9fd0-09e2284d06eb None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:47:03.268336 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-9fed2c19-2914-4e38-9fd0-09e2284d06eb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 18 00:47:03.268336 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:47:03.268336 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:47:03.268336 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:47:03.268336 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:47:03.268336 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:47:03.268336 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:47:03.268336 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:47:03.268336 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:47:03.268336 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:47:03.268336 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:47:03.268336 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:47:03.268336 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 00:47:03.268336 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 00:47:03.268336 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 00:47:03.268336 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 00:47:03.269581 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:47:03.269581 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:47:03.269581 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 00:47:03.269581 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:47:03.269581 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 00:47:03.269581 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:47:03.269581 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:47:03.269581 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:47:03.269581 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:47:03.269581 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:47:03.269581 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:47:03.269581 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:47:03.269581 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:47:03.269581 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:47:03.269581 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:47:03.269581 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:47:03.269581 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:47:03.269581 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:47:03.270988 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:47:03.270988 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:47:03.270988 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 00:47:03.270988 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 00:47:03.270988 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 00:47:03.270988 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 00:47:03.270988 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 00:47:03.270988 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 00:47:03.270988 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 18 00:47:03.270988 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:47:03.270988 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 651/1267] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:47:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:47:03.276111 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da70c5b8-65f8-485c-bac2-2a88a7e994a5 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:47:03.395391 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da70c5b8-65f8-485c-bac2-2a88a7e994a5 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:47:03.432221 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b4e1f-81d0-4bd7-be9e-58db71ae5bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:47:03.432846 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b4e1f-81d0-4bd7-be9e-58db71ae5bbc None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:47:03.433128 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b4e1f-81d0-4bd7-be9e-58db71ae5bbc None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:47:03.433405 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b4e1f-81d0-4bd7-be9e-58db71ae5bbc None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:47:03.434150 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761b4e1f-81d0-4bd7-be9e-58db71ae5bbc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:47:03.434459 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761b4e1f-81d0-4bd7-be9e-58db71ae5bbc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:47:03.435948 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761b4e1f-81d0-4bd7-be9e-58db71ae5bbc None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:47:03.447727 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:47:03.457177 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 617/1268] 10.222.0.15 () {56 vars in 1143 bytes} [Sun Sep 18 00:47:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:47:03.463638 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed2c19-2914-4e38-9fd0-09e2284d06eb None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:47:03.570153 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed2c19-2914-4e38-9fd0-09e2284d06eb None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:47:03.607331 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9823cd6f-d64b-4b18-aa48-1abba8babdd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:47:03.607989 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823cd6f-d64b-4b18-aa48-1abba8babdd3 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:47:03.608268 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823cd6f-d64b-4b18-aa48-1abba8babdd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:47:03.608535 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823cd6f-d64b-4b18-aa48-1abba8babdd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:47:03.619175 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9823cd6f-d64b-4b18-aa48-1abba8babdd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:47:03.620636 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9823cd6f-d64b-4b18-aa48-1abba8babdd3 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:47:03.635199 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-9823cd6f-d64b-4b18-aa48-1abba8babdd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:47:03.635199 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:47:03.635199 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:47:03.635199 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:47:03.635199 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:47:03.635199 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:47:03.635199 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:47:03.635199 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:47:03.635199 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:47:03.635199 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:47:03.635199 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:47:03.635199 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:47:03.635199 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:47:03.635199 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:47:03.635199 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:47:03.635199 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:47:03.636436 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:47:03.636436 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:47:03.636436 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:47:03.636436 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:47:03.636436 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:47:03.636436 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:47:03.636436 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:47:03.636436 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:47:03.636436 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:47:03.636436 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:47:03.636436 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:47:03.636436 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:47:03.636436 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:47:03.636436 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:47:03.636436 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:47:03.636436 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:47:03.636436 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:47:03.637688 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:47:03.637688 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:47:03.637688 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:47:03.637688 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 652/1269] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:47:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:47:03.642264 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b4e1f-81d0-4bd7-be9e-58db71ae5bbc None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:47:03.743724 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b4e1f-81d0-4bd7-be9e-58db71ae5bbc None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:47:03.779181 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74deb01a-cf3b-40ac-8d70-630f486d9782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:47:03.779790 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74deb01a-cf3b-40ac-8d70-630f486d9782 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:47:03.780107 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74deb01a-cf3b-40ac-8d70-630f486d9782 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:47:03.780384 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74deb01a-cf3b-40ac-8d70-630f486d9782 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:47:03.781024 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74deb01a-cf3b-40ac-8d70-630f486d9782 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:47:03.781328 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74deb01a-cf3b-40ac-8d70-630f486d9782 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:47:03.782703 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74deb01a-cf3b-40ac-8d70-630f486d9782 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:47:03.796300 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 618/1270] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:47:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:47:03.802107 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9823cd6f-d64b-4b18-aa48-1abba8babdd3 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:47:03.833865 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:47:03.901814 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9823cd6f-d64b-4b18-aa48-1abba8babdd3 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:47:03.945533 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd65341e-fe1f-4949-9535-db85420fa2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:47:03.946246 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65341e-fe1f-4949-9535-db85420fa2ef None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:47:03.946590 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65341e-fe1f-4949-9535-db85420fa2ef None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:47:03.946916 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65341e-fe1f-4949-9535-db85420fa2ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:47:03.955744 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd65341e-fe1f-4949-9535-db85420fa2ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:47:03.957791 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd65341e-fe1f-4949-9535-db85420fa2ef None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:47:03.977198 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-bd65341e-fe1f-4949-9535-db85420fa2ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:47:03.977198 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:47:03.977198 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:47:03.977198 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:47:03.977198 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:47:03.977198 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:47:03.977198 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:47:03.977198 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:47:03.977198 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:47:03.977198 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:47:03.977198 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:47:03.977198 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:47:03.977198 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 00:47:03.977198 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 00:47:03.977198 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 00:47:03.978261 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 00:47:03.978261 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:47:03.978261 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:47:03.978261 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:47:03.978261 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:47:03.978261 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:47:03.978261 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:47:03.978261 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:47:03.978261 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:47:03.978261 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:47:03.978261 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:47:03.978261 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:47:03.978261 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:47:03.978261 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:47:03.978261 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:47:03.978261 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:47:03.978261 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:47:03.979210 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 00:47:03.979210 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 00:47:03.979210 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 00:47:03.979210 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 00:47:03.979210 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 00:47:03.979210 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 00:47:03.979210 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:47:03.979210 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:47:03.979210 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 653/1271] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Sep 18 00:47:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:47:03.985726 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74deb01a-cf3b-40ac-8d70-630f486d9782 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:47:04.046585 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:47:04.088456 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74deb01a-cf3b-40ac-8d70-630f486d9782 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:47:04.122116 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8634a2-f539-4bc6-bf76-198d41c3ea19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:47:04.122720 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8634a2-f539-4bc6-bf76-198d41c3ea19 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:47:04.122998 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8634a2-f539-4bc6-bf76-198d41c3ea19 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:47:04.123270 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8634a2-f539-4bc6-bf76-198d41c3ea19 None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:47:04.123978 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8634a2-f539-4bc6-bf76-198d41c3ea19 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:47:04.124284 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8634a2-f539-4bc6-bf76-198d41c3ea19 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:47:04.125709 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8634a2-f539-4bc6-bf76-198d41c3ea19 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:47:04.138106 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 619/1272] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Sep 18 00:47:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:47:04.144277 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd65341e-fe1f-4949-9535-db85420fa2ef None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:47:04.235211 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:47:04.245429 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd65341e-fe1f-4949-9535-db85420fa2ef None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:47:04.281101 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d77cc-25ba-46f8-bb7f-306c9a25ff2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:47:04.281782 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d77cc-25ba-46f8-bb7f-306c9a25ff2a None admin] REQUEST_METHOD: `PUT` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:47:04.282059 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d77cc-25ba-46f8-bb7f-306c9a25ff2a None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:47:04.282330 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d77cc-25ba-46f8-bb7f-306c9a25ff2a None admin] PATH_INFO: `/v3/projects/52ebde8fa3f84ede9ef575f7c0780798/users/7239e730ee034affb6bdf27e106c49cb/roles/591d4711dc204cf98003c8b7d7558506` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:47:04.284372 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322d77cc-25ba-46f8-bb7f-306c9a25ff2a None admin] RBAC: Authorizing `identity:create_grant(project_id=52ebde8fa3f84ede9ef575f7c0780798, user_id=7239e730ee034affb6bdf27e106c49cb, role_id=591d4711dc204cf98003c8b7d7558506)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:47:04.285845 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322d77cc-25ba-46f8-bb7f-306c9a25ff2a None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:47:04.301524 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 654/1273] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Sep 18 00:47:04 2022] PUT /identity/v3/projects/52ebde8fa3f84ede9ef575f7c0780798/users/7239e730ee034affb6bdf27e106c49cb/roles/591d4711dc204cf98003c8b7d7558506 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 00:47:06.443720 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c49dc71-2f4a-4b32-abc8-e5996a194aea None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:47:06.444321 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c49dc71-2f4a-4b32-abc8-e5996a194aea None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:47:06.444321 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c49dc71-2f4a-4b32-abc8-e5996a194aea None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:47:06.445623 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 620/1274] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:47:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:47:06.451123 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952cc926-36f7-4213-9819-3c977138bb7d None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:47:06.451548 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952cc926-36f7-4213-9819-3c977138bb7d None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:47:06.451691 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952cc926-36f7-4213-9819-3c977138bb7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:47:06.470603 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-952cc926-36f7-4213-9819-3c977138bb7d None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:47:06.471817 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-952cc926-36f7-4213-9819-3c977138bb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:47:06.538952 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 655/1275] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:47:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 00:47:06.808809 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c49dc71-2f4a-4b32-abc8-e5996a194aea None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:47:06.910350 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c49dc71-2f4a-4b32-abc8-e5996a194aea None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:47:06.929156 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:47:06.946943 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8a0cf9-0f7c-4c72-9a6f-9ea6a84ee545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:47:06.947580 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a0cf9-0f7c-4c72-9a6f-9ea6a84ee545 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:47:06.947860 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a0cf9-0f7c-4c72-9a6f-9ea6a84ee545 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:47:06.948163 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a0cf9-0f7c-4c72-9a6f-9ea6a84ee545 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:47:06.958850 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8a0cf9-0f7c-4c72-9a6f-9ea6a84ee545 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 18 00:47:06.963752 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-3a8a0cf9-0f7c-4c72-9a6f-9ea6a84ee545 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 00:47:06.963752 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:47:06.963752 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:47:06.963752 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:47:06.963752 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:47:06.963752 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:47:06.963752 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:47:06.963752 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:47:06.963752 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:47:06.963752 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:47:06.963752 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:47:06.963752 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:47:06.963752 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 18 00:47:06.963752 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 18 00:47:06.963752 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 18 00:47:06.963752 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 18 00:47:06.965139 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 18 00:47:06.965139 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 18 00:47:06.965139 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 18 00:47:06.965139 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 18 00:47:06.965139 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:47:06.965139 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:47:06.965139 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:47:06.965139 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:47:06.965139 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:47:06.965139 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:47:06.965139 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:47:06.965139 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:47:06.965139 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:47:06.965139 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:47:06.965139 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:47:06.965139 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:47:06.966278 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:47:06.966278 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:47:06.966278 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:47:06.966278 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:47:06.966278 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 18 00:47:06.966278 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 18 00:47:06.966278 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 18 00:47:06.966278 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 18 00:47:06.966278 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 18 00:47:06.966278 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 18 00:47:06.966278 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 18 00:47:06.966278 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:47:06.966278 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 621/1276] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Sep 18 00:47:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:47:06.971262 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952cc926-36f7-4213-9819-3c977138bb7d None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:47:07.069459 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:47:07.088705 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952cc926-36f7-4213-9819-3c977138bb7d None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:47:07.122859 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ffe628-c8a7-4b64-9131-54491b2b7e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:47:07.123466 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ffe628-c8a7-4b64-9131-54491b2b7e90 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:47:07.123750 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ffe628-c8a7-4b64-9131-54491b2b7e90 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:47:07.124054 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ffe628-c8a7-4b64-9131-54491b2b7e90 None admin] PATH_INFO: `/v3/roles` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:47:07.124719 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ffe628-c8a7-4b64-9131-54491b2b7e90 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:47:07.125029 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ffe628-c8a7-4b64-9131-54491b2b7e90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:47:07.126387 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ffe628-c8a7-4b64-9131-54491b2b7e90 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:47:07.135051 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 656/1277] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Sep 18 00:47:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:47:07.141072 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8a0cf9-0f7c-4c72-9a6f-9ea6a84ee545 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:47:07.242583 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8a0cf9-0f7c-4c72-9a6f-9ea6a84ee545 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:47:07.275832 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dce127-d1fc-4b61-afea-43691ac02f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:47:07.276502 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dce127-d1fc-4b61-afea-43691ac02f17 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:47:07.276779 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dce127-d1fc-4b61-afea-43691ac02f17 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:47:07.277055 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dce127-d1fc-4b61-afea-43691ac02f17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:47:07.288734 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dce127-d1fc-4b61-afea-43691ac02f17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:47:07.290192 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dce127-d1fc-4b61-afea-43691ac02f17 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:47:07.304970 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-91dce127-d1fc-4b61-afea-43691ac02f17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:47:07.304970 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:47:07.304970 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:47:07.304970 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:47:07.304970 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:47:07.304970 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:47:07.304970 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:47:07.304970 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:47:07.304970 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:47:07.304970 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:47:07.304970 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:47:07.304970 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:47:07.304970 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:47:07.304970 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:47:07.304970 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:47:07.304970 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:47:07.306072 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:47:07.306072 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:47:07.306072 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:47:07.306072 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:47:07.306072 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:47:07.306072 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:47:07.306072 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:47:07.306072 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:47:07.306072 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:47:07.306072 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:47:07.306072 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:47:07.306072 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:47:07.306072 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:47:07.306072 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:47:07.306072 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:47:07.306072 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:47:07.306072 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:47:07.307173 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:47:07.307173 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:47:07.307173 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:47:07.307173 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 622/1278] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:47:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:47:07.312756 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ffe628-c8a7-4b64-9131-54491b2b7e90 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:47:07.420429 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ffe628-c8a7-4b64-9131-54491b2b7e90 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:47:07.470438 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3cb7aa-dbb2-4553-a589-d9c2c5e7cecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:47:07.471434 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3cb7aa-dbb2-4553-a589-d9c2c5e7cecf None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:47:07.471988 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3cb7aa-dbb2-4553-a589-d9c2c5e7cecf None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:47:07.472518 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3cb7aa-dbb2-4553-a589-d9c2c5e7cecf None admin] PATH_INFO: `/v3/domains` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:47:07.473705 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3cb7aa-dbb2-4553-a589-d9c2c5e7cecf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:47:07.474083 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3cb7aa-dbb2-4553-a589-d9c2c5e7cecf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:47:07.477210 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3cb7aa-dbb2-4553-a589-d9c2c5e7cecf None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:47:07.498098 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 657/1279] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:47:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:47:07.503919 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dce127-d1fc-4b61-afea-43691ac02f17 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:47:07.534940 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:47:07.623837 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dce127-d1fc-4b61-afea-43691ac02f17 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:47:07.658854 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de00a05f-aa0a-46c0-8b6b-15ffc7f4a535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:47:07.659478 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00a05f-aa0a-46c0-8b6b-15ffc7f4a535 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:47:07.659758 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00a05f-aa0a-46c0-8b6b-15ffc7f4a535 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:47:07.660065 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00a05f-aa0a-46c0-8b6b-15ffc7f4a535 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:47:07.668486 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de00a05f-aa0a-46c0-8b6b-15ffc7f4a535 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:47:07.669923 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de00a05f-aa0a-46c0-8b6b-15ffc7f4a535 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:47:07.680929 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-de00a05f-aa0a-46c0-8b6b-15ffc7f4a535 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 18 00:47:07.680929 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:47:07.680929 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:47:07.680929 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:47:07.680929 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:47:07.680929 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:47:07.680929 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:47:07.680929 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:47:07.680929 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:47:07.680929 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:47:07.680929 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:47:07.680929 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:47:07.680929 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 18 00:47:07.680929 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 18 00:47:07.680929 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 18 00:47:07.680929 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 18 00:47:07.682034 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:47:07.682034 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:47:07.682034 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 18 00:47:07.682034 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:47:07.682034 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 18 00:47:07.682034 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 18 00:47:07.682034 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:47:07.682034 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:47:07.682034 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:47:07.682034 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:47:07.682034 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:47:07.682034 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:47:07.682034 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:47:07.682034 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:47:07.682034 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:47:07.682034 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:47:07.682034 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:47:07.682034 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:47:07.683329 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:47:07.683329 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:47:07.683329 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 18 00:47:07.683329 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 18 00:47:07.683329 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 18 00:47:07.683329 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 18 00:47:07.683329 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 18 00:47:07.683329 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 18 00:47:07.683329 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 18 00:47:07.683329 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:47:07.683329 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 623/1280] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:47:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 18 00:47:07.687794 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3cb7aa-dbb2-4553-a589-d9c2c5e7cecf None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:47:07.691564 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:47:07.787324 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3cb7aa-dbb2-4553-a589-d9c2c5e7cecf None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:47:07.826023 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d19f84e-1095-4dab-a389-13c8aa1cd47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:47:07.826640 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19f84e-1095-4dab-a389-13c8aa1cd47f None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:47:07.826928 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19f84e-1095-4dab-a389-13c8aa1cd47f None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:47:07.827208 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19f84e-1095-4dab-a389-13c8aa1cd47f None admin] PATH_INFO: `/v3/users` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:47:07.827972 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d19f84e-1095-4dab-a389-13c8aa1cd47f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:47:07.828285 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d19f84e-1095-4dab-a389-13c8aa1cd47f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:47:07.829715 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d19f84e-1095-4dab-a389-13c8aa1cd47f None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:47:07.847277 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 658/1281] 10.222.0.15 () {56 vars in 1143 bytes} [Sun Sep 18 00:47:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:47:07.853270 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de00a05f-aa0a-46c0-8b6b-15ffc7f4a535 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:47:07.949472 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:47:07.959770 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de00a05f-aa0a-46c0-8b6b-15ffc7f4a535 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:47:07.995534 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc5060d-d2d2-4344-a422-d8289de72410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:47:07.996185 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5060d-d2d2-4344-a422-d8289de72410 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:47:07.996467 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5060d-d2d2-4344-a422-d8289de72410 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:47:07.996739 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5060d-d2d2-4344-a422-d8289de72410 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:47:08.062739 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc5060d-d2d2-4344-a422-d8289de72410 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:47:08.064217 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc5060d-d2d2-4344-a422-d8289de72410 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:47:08.152351 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:47:08.163676 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 624/1282] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Sep 18 00:47:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 18 00:47:08.169680 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d19f84e-1095-4dab-a389-13c8aa1cd47f None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:47:08.231491 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:47:08.270018 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d19f84e-1095-4dab-a389-13c8aa1cd47f None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:47:08.304847 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79598e7-3640-42db-990b-c4c2f43922f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:47:08.305490 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79598e7-3640-42db-990b-c4c2f43922f9 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:47:08.305768 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79598e7-3640-42db-990b-c4c2f43922f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:47:08.306037 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79598e7-3640-42db-990b-c4c2f43922f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:47:08.315996 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79598e7-3640-42db-990b-c4c2f43922f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:47:08.317441 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79598e7-3640-42db-990b-c4c2f43922f9 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:47:08.332333 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-b79598e7-3640-42db-990b-c4c2f43922f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:47:08.332333 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:47:08.332333 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:47:08.332333 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:47:08.332333 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:47:08.332333 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:47:08.332333 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:47:08.332333 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:47:08.332333 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:47:08.332333 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:47:08.332333 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:47:08.332333 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:47:08.332333 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 18 00:47:08.332333 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 18 00:47:08.332333 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 18 00:47:08.332333 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 18 00:47:08.333475 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:47:08.333475 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:47:08.333475 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:47:08.333475 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:47:08.333475 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:47:08.333475 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:47:08.333475 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:47:08.333475 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:47:08.333475 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:47:08.333475 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:47:08.333475 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:47:08.333475 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:47:08.333475 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:47:08.333475 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:47:08.333475 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:47:08.333475 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:47:08.333475 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 18 00:47:08.334376 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 18 00:47:08.334376 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 18 00:47:08.334376 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:47:08.334376 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 659/1283] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:47:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:47:08.339238 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc5060d-d2d2-4344-a422-d8289de72410 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:47:08.441677 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc5060d-d2d2-4344-a422-d8289de72410 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:47:08.477017 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469244b9-1ef3-469d-aa89-2cd1629df289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:47:08.477634 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469244b9-1ef3-469d-aa89-2cd1629df289 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:47:08.477916 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469244b9-1ef3-469d-aa89-2cd1629df289 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:47:08.478190 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469244b9-1ef3-469d-aa89-2cd1629df289 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:47:08.478830 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469244b9-1ef3-469d-aa89-2cd1629df289 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:47:08.479134 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469244b9-1ef3-469d-aa89-2cd1629df289 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:47:08.480538 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469244b9-1ef3-469d-aa89-2cd1629df289 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:47:08.492538 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 625/1284] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Sep 18 00:47:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:47:08.498269 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79598e7-3640-42db-990b-c4c2f43922f9 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:47:08.599037 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79598e7-3640-42db-990b-c4c2f43922f9 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:47:08.614328 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:47:08.636789 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eda9e1-bf41-4657-8a11-fd7f0dac4a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:47:08.637430 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eda9e1-bf41-4657-8a11-fd7f0dac4a94 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:47:08.637707 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eda9e1-bf41-4657-8a11-fd7f0dac4a94 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:47:08.637978 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eda9e1-bf41-4657-8a11-fd7f0dac4a94 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:47:08.645417 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eda9e1-bf41-4657-8a11-fd7f0dac4a94 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:47:08.646945 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eda9e1-bf41-4657-8a11-fd7f0dac4a94 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:47:08.659421 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application [None req-59eda9e1-bf41-4657-8a11-fd7f0dac4a94 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:47:08.659421 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:47:08.659421 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:47:08.659421 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:47:08.659421 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:47:08.659421 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:47:08.659421 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:47:08.659421 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:47:08.659421 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:47:08.659421 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:47:08.659421 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:47:08.659421 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:47:08.659421 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 18 00:47:08.659421 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 18 00:47:08.659421 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 18 00:47:08.660687 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 18 00:47:08.660687 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:47:08.660687 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:47:08.660687 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:47:08.660687 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:47:08.660687 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:47:08.660687 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:47:08.660687 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:47:08.660687 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application with Lock( Sep 18 00:47:08.660687 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:47:08.660687 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:47:08.660687 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:47:08.660687 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:47:08.660687 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:47:08.660687 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:47:08.660687 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:47:08.660687 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:47:08.662906 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 18 00:47:08.662906 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 18 00:47:08.662906 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 18 00:47:08.662906 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 18 00:47:08.662906 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 18 00:47:08.662906 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 18 00:47:08.662906 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 18 00:47:08.662906 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: ERROR keystone.server.flask.application Sep 18 00:47:08.662906 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 660/1285] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Sep 18 00:47:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:47:08.667510 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469244b9-1ef3-469d-aa89-2cd1629df289 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:47:08.720411 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:47:08.777700 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469244b9-1ef3-469d-aa89-2cd1629df289 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:47:08.810625 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad6a269-361e-455e-8867-d677288d4720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:47:08.811236 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad6a269-361e-455e-8867-d677288d4720 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:47:08.811516 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad6a269-361e-455e-8867-d677288d4720 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:47:08.811792 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad6a269-361e-455e-8867-d677288d4720 None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:47:08.812532 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad6a269-361e-455e-8867-d677288d4720 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:47:08.812836 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad6a269-361e-455e-8867-d677288d4720 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:47:08.814272 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad6a269-361e-455e-8867-d677288d4720 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:47:08.826755 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 626/1286] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Sep 18 00:47:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:47:08.832877 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eda9e1-bf41-4657-8a11-fd7f0dac4a94 None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:47:08.930479 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eda9e1-bf41-4657-8a11-fd7f0dac4a94 None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:47:08.971407 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ada59a3-e94d-41cd-ad60-3f67d4ac8313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:47:08.972168 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada59a3-e94d-41cd-ad60-3f67d4ac8313 None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:47:08.972476 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada59a3-e94d-41cd-ad60-3f67d4ac8313 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:47:08.972781 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada59a3-e94d-41cd-ad60-3f67d4ac8313 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:47:08.973617 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ada59a3-e94d-41cd-ad60-3f67d4ac8313 None admin] RBAC: Adding query filter params (role.id=591d4711dc204cf98003c8b7d7558506, scope.project.id=52ebde8fa3f84ede9ef575f7c0780798, user.id=7239e730ee034affb6bdf27e106c49cb) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:47:08.973990 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ada59a3-e94d-41cd-ad60-3f67d4ac8313 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:47:08.975727 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ada59a3-e94d-41cd-ad60-3f67d4ac8313 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:47:08.981549 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 661/1287] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Sep 18 00:47:08 2022] GET /identity/v3/role_assignments?user.id=7239e730ee034affb6bdf27e106c49cb&scope.project.id=52ebde8fa3f84ede9ef575f7c0780798&role.id=591d4711dc204cf98003c8b7d7558506 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:47:11.171918 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51126bc-3fa2-4be8-9743-2ebb5c665f0e None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:47:11.172496 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51126bc-3fa2-4be8-9743-2ebb5c665f0e None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:47:11.172496 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51126bc-3fa2-4be8-9743-2ebb5c665f0e None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:47:11.173834 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 627/1288] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:47:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:47:11.179947 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa8fa82-e80b-4961-9e29-219238a06f0e None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:47:11.180405 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa8fa82-e80b-4961-9e29-219238a06f0e None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:47:11.180507 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa8fa82-e80b-4961-9e29-219238a06f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:47:11.198722 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-1aa8fa82-e80b-4961-9e29-219238a06f0e None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:47:11.199944 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-1aa8fa82-e80b-4961-9e29-219238a06f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:47:11.229343 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:47:11.268597 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 662/1289] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:47:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 00:47:11.539103 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51126bc-3fa2-4be8-9743-2ebb5c665f0e None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:47:11.642603 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51126bc-3fa2-4be8-9743-2ebb5c665f0e None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:47:11.655574 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:47:11.680729 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63072d03-b377-4f8d-bfec-4498b94260c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:47:11.681366 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63072d03-b377-4f8d-bfec-4498b94260c0 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:47:11.681649 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63072d03-b377-4f8d-bfec-4498b94260c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:47:11.681924 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63072d03-b377-4f8d-bfec-4498b94260c0 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:47:11.682511 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63072d03-b377-4f8d-bfec-4498b94260c0 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:47:11.683910 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63072d03-b377-4f8d-bfec-4498b94260c0 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:47:11.692562 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-63072d03-b377-4f8d-bfec-4498b94260c0 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 18 00:47:11.692562 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:47:11.692562 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 18 00:47:11.692562 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 18 00:47:11.692562 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 18 00:47:11.692562 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 18 00:47:11.692562 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 18 00:47:11.692562 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 00:47:11.692562 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 18 00:47:11.692562 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:47:11.692562 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 18 00:47:11.692562 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:47:11.692562 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:47:11.692562 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:47:11.692562 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:47:11.692562 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:47:11.692562 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:47:11.693771 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:47:11.693771 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:47:11.693771 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:47:11.693771 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:47:11.693771 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:47:11.693771 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:47:11.693771 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 18 00:47:11.693771 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 18 00:47:11.693771 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 18 00:47:11.693771 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 18 00:47:11.693771 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:47:11.693771 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:47:11.693771 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:47:11.693771 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:47:11.693771 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:47:11.693771 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:47:11.695017 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:47:11.695017 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:47:11.695017 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:47:11.695017 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:47:11.695017 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:47:11.695017 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:47:11.695017 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:47:11.695017 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:47:11.695017 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:47:11.695017 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:47:11.695017 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 18 00:47:11.695017 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 00:47:11.695017 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 18 00:47:11.695017 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:47:11.695017 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 628/1290] 10.222.0.15 () {56 vars in 1117 bytes} [Sun Sep 18 00:47:11 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:47:11.699725 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa8fa82-e80b-4961-9e29-219238a06f0e None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:47:11.797628 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa8fa82-e80b-4961-9e29-219238a06f0e None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:47:11.831029 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af79baee-7fbe-4f4d-b3e0-1c3e92e274ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:47:11.831635 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79baee-7fbe-4f4d-b3e0-1c3e92e274ee None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:47:11.831938 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79baee-7fbe-4f4d-b3e0-1c3e92e274ee None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:47:11.832218 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79baee-7fbe-4f4d-b3e0-1c3e92e274ee None admin] PATH_INFO: `/v3/services` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:47:11.832847 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af79baee-7fbe-4f4d-b3e0-1c3e92e274ee None admin] RBAC: Adding query filter params (name=placement) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:47:11.833153 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af79baee-7fbe-4f4d-b3e0-1c3e92e274ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:47:11.835091 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af79baee-7fbe-4f4d-b3e0-1c3e92e274ee None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:47:11.840101 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 663/1291] 10.222.0.15 () {56 vars in 1116 bytes} [Sun Sep 18 00:47:11 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:47:11.846589 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63072d03-b377-4f8d-bfec-4498b94260c0 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:47:11.953218 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63072d03-b377-4f8d-bfec-4498b94260c0 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:47:11.993959 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d2f2bf-cd13-458f-8b2b-fc33329637f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:47:11.994660 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2f2bf-cd13-458f-8b2b-fc33329637f2 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:47:11.995004 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2f2bf-cd13-458f-8b2b-fc33329637f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:47:11.995334 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2f2bf-cd13-458f-8b2b-fc33329637f2 None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:47:11.996212 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d2f2bf-cd13-458f-8b2b-fc33329637f2 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:47:11.996582 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d2f2bf-cd13-458f-8b2b-fc33329637f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:47:11.998183 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d2f2bf-cd13-458f-8b2b-fc33329637f2 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:47:12.003652 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 629/1292] 10.222.0.15 () {56 vars in 1116 bytes} [Sun Sep 18 00:47:11 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:47:14.147136 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1221d90-10a4-49db-813a-565b597483c0 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:47:14.148204 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1221d90-10a4-49db-813a-565b597483c0 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:47:14.148330 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1221d90-10a4-49db-813a-565b597483c0 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:47:14.149707 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 664/1293] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:47:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:47:14.154959 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de89f5-4375-48ec-a512-8424b2d9eed7 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:47:14.155347 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de89f5-4375-48ec-a512-8424b2d9eed7 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:47:14.155519 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de89f5-4375-48ec-a512-8424b2d9eed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:47:14.173756 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-f4de89f5-4375-48ec-a512-8424b2d9eed7 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:47:14.174943 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-f4de89f5-4375-48ec-a512-8424b2d9eed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:47:14.203947 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:47:14.240669 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 630/1294] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:47:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 00:47:14.511165 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1221d90-10a4-49db-813a-565b597483c0 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:47:14.542864 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:47:14.612046 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1221d90-10a4-49db-813a-565b597483c0 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:47:14.643909 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45828d5-2331-47a2-9c24-cb2770b6a554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:47:14.644513 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45828d5-2331-47a2-9c24-cb2770b6a554 None admin] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:47:14.644791 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45828d5-2331-47a2-9c24-cb2770b6a554 None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:47:14.645064 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45828d5-2331-47a2-9c24-cb2770b6a554 None admin] PATH_INFO: `/v3/services` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:47:14.645718 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45828d5-2331-47a2-9c24-cb2770b6a554 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:47:14.647611 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45828d5-2331-47a2-9c24-cb2770b6a554 None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:47:14.663252 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 665/1295] 10.222.0.15 () {60 vars in 1141 bytes} [Sun Sep 18 00:47:14 2022] POST /identity/v3/services => generated 246 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 00:47:16.824641 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b0d1c-513d-4b10-bbad-8dbcd2aadb2c None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:47:16.825184 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b0d1c-513d-4b10-bbad-8dbcd2aadb2c None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:47:16.825184 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b0d1c-513d-4b10-bbad-8dbcd2aadb2c None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:47:16.826443 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 631/1296] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:47:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:47:16.831484 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785f7c5-23d7-4dd4-b12c-afdf3706338e None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:47:16.831885 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785f7c5-23d7-4dd4-b12c-afdf3706338e None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:47:16.832058 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785f7c5-23d7-4dd4-b12c-afdf3706338e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:47:16.851005 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-2785f7c5-23d7-4dd4-b12c-afdf3706338e None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:47:16.852246 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-2785f7c5-23d7-4dd4-b12c-afdf3706338e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:47:16.925319 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 666/1297] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:47:16 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 00:47:17.191808 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b0d1c-513d-4b10-bbad-8dbcd2aadb2c None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:47:17.291638 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b0d1c-513d-4b10-bbad-8dbcd2aadb2c None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:47:17.325013 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c291ba4-77db-4d88-aa57-a3e017f69c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:47:17.325637 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c291ba4-77db-4d88-aa57-a3e017f69c18 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:47:17.325921 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c291ba4-77db-4d88-aa57-a3e017f69c18 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:47:17.326195 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c291ba4-77db-4d88-aa57-a3e017f69c18 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:47:17.326773 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c291ba4-77db-4d88-aa57-a3e017f69c18 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:47:17.328170 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c291ba4-77db-4d88-aa57-a3e017f69c18 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:47:17.337327 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-3c291ba4-77db-4d88-aa57-a3e017f69c18 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 18 00:47:17.337327 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:47:17.337327 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 18 00:47:17.337327 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 18 00:47:17.337327 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 18 00:47:17.337327 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 18 00:47:17.337327 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 18 00:47:17.337327 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 00:47:17.337327 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 18 00:47:17.337327 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:47:17.337327 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 18 00:47:17.337327 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:47:17.337327 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:47:17.337327 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:47:17.337327 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:47:17.337327 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:47:17.337327 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:47:17.338481 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:47:17.338481 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:47:17.338481 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:47:17.338481 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:47:17.338481 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:47:17.338481 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:47:17.338481 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 18 00:47:17.338481 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 18 00:47:17.338481 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 18 00:47:17.338481 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 18 00:47:17.338481 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:47:17.338481 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:47:17.338481 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:47:17.338481 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:47:17.338481 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:47:17.338481 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:47:17.339344 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:47:17.339344 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:47:17.339344 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:47:17.339344 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:47:17.339344 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:47:17.339344 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:47:17.339344 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:47:17.339344 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:47:17.339344 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:47:17.339344 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:47:17.339344 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 18 00:47:17.339344 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 00:47:17.339344 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 18 00:47:17.339344 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:47:17.339344 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 632/1298] 10.222.0.15 () {56 vars in 1117 bytes} [Sun Sep 18 00:47:17 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:47:17.344506 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2785f7c5-23d7-4dd4-b12c-afdf3706338e None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:47:17.362842 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:47:17.442974 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2785f7c5-23d7-4dd4-b12c-afdf3706338e None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:47:17.476931 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd079c82-abb5-4991-b149-f382223e59fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:47:17.477542 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd079c82-abb5-4991-b149-f382223e59fb None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:47:17.477819 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd079c82-abb5-4991-b149-f382223e59fb None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:47:17.478087 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd079c82-abb5-4991-b149-f382223e59fb None admin] PATH_INFO: `/v3/services` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:47:17.478711 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd079c82-abb5-4991-b149-f382223e59fb None admin] RBAC: Adding query filter params (name=placement) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:47:17.479009 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd079c82-abb5-4991-b149-f382223e59fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:47:17.480400 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd079c82-abb5-4991-b149-f382223e59fb None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:47:17.485427 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 667/1299] 10.222.0.15 () {56 vars in 1116 bytes} [Sun Sep 18 00:47:17 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:47:17.491682 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c291ba4-77db-4d88-aa57-a3e017f69c18 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:47:17.524143 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:47:17.591236 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c291ba4-77db-4d88-aa57-a3e017f69c18 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:47:17.623753 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b7e66-fac7-42ac-bbe7-237d5af0b924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:47:17.624401 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b7e66-fac7-42ac-bbe7-237d5af0b924 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:47:17.624681 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b7e66-fac7-42ac-bbe7-237d5af0b924 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:47:17.624951 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b7e66-fac7-42ac-bbe7-237d5af0b924 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:47:17.625668 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506b7e66-fac7-42ac-bbe7-237d5af0b924 None admin] RBAC: Adding query filter params (interface=public, service_id=1021585e8d504e2fb048e0c94b6692d4, region_id=RegionOne) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:47:17.625974 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506b7e66-fac7-42ac-bbe7-237d5af0b924 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:47:17.627330 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506b7e66-fac7-42ac-bbe7-237d5af0b924 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:47:17.632204 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 633/1300] 10.222.0.15 () {56 vars in 1251 bytes} [Sun Sep 18 00:47:17 2022] GET /identity/v3/endpoints?service_id=1021585e8d504e2fb048e0c94b6692d4&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:47:17.637921 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd079c82-abb5-4991-b149-f382223e59fb None admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:47:17.718118 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:47:17.736040 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd079c82-abb5-4991-b149-f382223e59fb None admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:47:17.769551 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dfb3b1-9194-40e7-b564-515da5f674eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:47:17.770165 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dfb3b1-9194-40e7-b564-515da5f674eb None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:47:17.770447 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dfb3b1-9194-40e7-b564-515da5f674eb None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:47:17.771298 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dfb3b1-9194-40e7-b564-515da5f674eb None admin] PATH_INFO: `/v3/services` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:47:17.771947 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dfb3b1-9194-40e7-b564-515da5f674eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:47:17.773324 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dfb3b1-9194-40e7-b564-515da5f674eb None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:47:17.780205 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 668/1301] 10.222.0.15 () {56 vars in 1087 bytes} [Sun Sep 18 00:47:17 2022] GET /identity/v3/services => generated 2191 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 00:47:19.917226 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd38b8-2181-4894-8821-00a61018b583 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:47:19.917783 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd38b8-2181-4894-8821-00a61018b583 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:47:19.917935 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd38b8-2181-4894-8821-00a61018b583 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:47:19.919504 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 634/1302] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:47:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:47:19.925433 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82af23-e903-4a71-b911-0ee2848ad7a7 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:47:19.925855 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82af23-e903-4a71-b911-0ee2848ad7a7 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:47:19.925990 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82af23-e903-4a71-b911-0ee2848ad7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:47:19.944305 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-1d82af23-e903-4a71-b911-0ee2848ad7a7 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:47:19.945497 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-1d82af23-e903-4a71-b911-0ee2848ad7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:47:20.012452 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 669/1303] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:47:19 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 18 00:47:20.280173 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dd38b8-2181-4894-8821-00a61018b583 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:47:20.373719 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:47:20.381278 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dd38b8-2181-4894-8821-00a61018b583 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:47:20.415041 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9176bf-4aab-4fb1-8f93-04b3a54b6cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:47:20.415676 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9176bf-4aab-4fb1-8f93-04b3a54b6cd4 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:47:20.415986 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9176bf-4aab-4fb1-8f93-04b3a54b6cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:47:20.416265 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9176bf-4aab-4fb1-8f93-04b3a54b6cd4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:47:20.416850 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9176bf-4aab-4fb1-8f93-04b3a54b6cd4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:47:20.418213 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9176bf-4aab-4fb1-8f93-04b3a54b6cd4 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:47:20.426794 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-ca9176bf-4aab-4fb1-8f93-04b3a54b6cd4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 18 00:47:20.426794 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:47:20.426794 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 18 00:47:20.426794 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 18 00:47:20.426794 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 18 00:47:20.426794 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 18 00:47:20.426794 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 18 00:47:20.426794 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 00:47:20.426794 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 18 00:47:20.426794 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:47:20.426794 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 18 00:47:20.426794 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:47:20.426794 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 18 00:47:20.426794 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 18 00:47:20.426794 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 18 00:47:20.426794 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 18 00:47:20.426794 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 18 00:47:20.427955 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 18 00:47:20.427955 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 18 00:47:20.427955 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 18 00:47:20.427955 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 18 00:47:20.427955 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 18 00:47:20.427955 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 18 00:47:20.427955 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 18 00:47:20.427955 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 18 00:47:20.427955 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 18 00:47:20.427955 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 18 00:47:20.427955 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 18 00:47:20.427955 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 18 00:47:20.427955 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 18 00:47:20.427955 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 18 00:47:20.427955 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 18 00:47:20.427955 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Sep 18 00:47:20.428975 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 18 00:47:20.428975 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Sep 18 00:47:20.428975 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 18 00:47:20.428975 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Sep 18 00:47:20.428975 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 18 00:47:20.428975 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 18 00:47:20.428975 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 18 00:47:20.428975 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Sep 18 00:47:20.428975 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 18 00:47:20.428975 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Sep 18 00:47:20.428975 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 18 00:47:20.428975 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 18 00:47:20.428975 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 18 00:47:20.428975 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: ERROR keystone.server.flask.application Sep 18 00:47:20.428975 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 635/1304] 10.222.0.15 () {56 vars in 1117 bytes} [Sun Sep 18 00:47:20 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 18 00:47:20.434032 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d82af23-e903-4a71-b911-0ee2848ad7a7 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:47:20.512571 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:47:20.536921 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d82af23-e903-4a71-b911-0ee2848ad7a7 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:47:20.569864 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a53c34d-96bb-45d5-8d36-83b81e8de07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:47:20.570467 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53c34d-96bb-45d5-8d36-83b81e8de07f None admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:47:20.570748 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53c34d-96bb-45d5-8d36-83b81e8de07f None admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:47:20.571020 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53c34d-96bb-45d5-8d36-83b81e8de07f None admin] PATH_INFO: `/v3/services` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:47:20.571637 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a53c34d-96bb-45d5-8d36-83b81e8de07f None admin] RBAC: Adding query filter params (name=placement) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:47:20.571966 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a53c34d-96bb-45d5-8d36-83b81e8de07f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:47:20.573324 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a53c34d-96bb-45d5-8d36-83b81e8de07f None admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:47:20.578311 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 670/1305] 10.222.0.15 () {56 vars in 1116 bytes} [Sun Sep 18 00:47:20 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:47:20.584639 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9176bf-4aab-4fb1-8f93-04b3a54b6cd4 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:47:20.683794 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9176bf-4aab-4fb1-8f93-04b3a54b6cd4 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:47:20.716584 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273feaa4-02e9-43c9-aba0-27512b454e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:47:20.717190 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273feaa4-02e9-43c9-aba0-27512b454e6f None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:47:20.717469 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273feaa4-02e9-43c9-aba0-27512b454e6f None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:47:20.717742 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273feaa4-02e9-43c9-aba0-27512b454e6f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:47:20.718409 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273feaa4-02e9-43c9-aba0-27512b454e6f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:47:20.719775 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273feaa4-02e9-43c9-aba0-27512b454e6f None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:47:20.739589 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 636/1306] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Sep 18 00:47:20 2022] POST /identity/v3/endpoints => generated 331 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 00:47:30.575379 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=30 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:47:30.735508 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:48:28.964594 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947c235-f880-4e0f-a69c-370706867eec None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:48:28.965074 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947c235-f880-4e0f-a69c-370706867eec None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:48:28.965154 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947c235-f880-4e0f-a69c-370706867eec None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:48:28.973147 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57da655-fcf9-484f-92a4-e8609d251f8e None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:48:28.973653 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57da655-fcf9-484f-92a4-e8609d251f8e None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:48:28.973733 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57da655-fcf9-484f-92a4-e8609d251f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:48:28.978403 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 671/1307] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:48:28 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:48:29.133281 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-a57da655-fcf9-484f-92a4-e8609d251f8e None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:48:29.134988 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-a57da655-fcf9-484f-92a4-e8609d251f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:48:29.297988 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 637/1308] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:48:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 00:48:29.603672 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff4044-d04e-4ce7-8508-d288d3ba6ec8 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:48:29.604087 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff4044-d04e-4ce7-8508-d288d3ba6ec8 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:48:29.604604 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff4044-d04e-4ce7-8508-d288d3ba6ec8 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:48:29.606318 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 672/1309] 10.222.0.15 () {54 vars in 963 bytes} [Sun Sep 18 00:48:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:48:29.613249 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895c090-4339-48a9-8e4a-a375f0c82309 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:48:29.613560 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895c090-4339-48a9-8e4a-a375f0c82309 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:48:29.613821 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895c090-4339-48a9-8e4a-a375f0c82309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:48:29.703846 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-4895c090-4339-48a9-8e4a-a375f0c82309 None None] MFA Rules not processed for user `9e46cfbc3b604788a833a81befaaab06`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:48:29.705610 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-4895c090-4339-48a9-8e4a-a375f0c82309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:48:29.731585 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:48:29.800749 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 638/1310] 10.222.0.15 () {58 vars in 1060 bytes} [Sun Sep 18 00:48:29 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:48:29.810014 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff4044-d04e-4ce7-8508-d288d3ba6ec8 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:48:29.811930 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-04ff4044-d04e-4ce7-8508-d288d3ba6ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:48:29.978572 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff4044-d04e-4ce7-8508-d288d3ba6ec8 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:48:30.072864 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b40443-1d9d-4619-8b5c-0703252341cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e46cfbc3b604788a833a81befaaab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:48:30.073381 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b40443-1d9d-4619-8b5c-0703252341cc service neutron] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:48:30.073673 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b40443-1d9d-4619-8b5c-0703252341cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:48:30.073951 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b40443-1d9d-4619-8b5c-0703252341cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:48:30.075620 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-73b40443-1d9d-4619-8b5c-0703252341cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:48:30.152746 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:48:30.227879 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b40443-1d9d-4619-8b5c-0703252341cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:48:30.229409 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b40443-1d9d-4619-8b5c-0703252341cc service neutron] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:48:30.251771 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 673/1311] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:48:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 00:48:33.200915 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbcb1e-85eb-4222-9163-720deead2ad3 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:48:33.201700 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbcb1e-85eb-4222-9163-720deead2ad3 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:48:33.201700 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbcb1e-85eb-4222-9163-720deead2ad3 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:48:33.203315 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 639/1312] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:48:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 18 00:48:33.209051 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea9464-e03d-4c9e-8eee-b23f9c60eb5a None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:48:33.209814 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea9464-e03d-4c9e-8eee-b23f9c60eb5a None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:48:33.209814 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea9464-e03d-4c9e-8eee-b23f9c60eb5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:48:33.373394 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-f3ea9464-e03d-4c9e-8eee-b23f9c60eb5a None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:48:33.375433 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-f3ea9464-e03d-4c9e-8eee-b23f9c60eb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:48:33.544367 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 674/1313] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:48:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 00:48:33.860311 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4adc686-9beb-4fe3-8b87-fe368062a9ef None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:48:33.860750 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4adc686-9beb-4fe3-8b87-fe368062a9ef None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:48:33.861099 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4adc686-9beb-4fe3-8b87-fe368062a9ef None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:48:33.862559 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 640/1314] 10.222.0.15 () {54 vars in 963 bytes} [Sun Sep 18 00:48:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:48:33.870287 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a5d83f-be5b-4ad1-9845-b103376ff24a None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:48:33.870802 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a5d83f-be5b-4ad1-9845-b103376ff24a None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:48:33.871277 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a5d83f-be5b-4ad1-9845-b103376ff24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:48:33.893571 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:48:33.982345 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-76a5d83f-be5b-4ad1-9845-b103376ff24a None None] MFA Rules not processed for user `9e46cfbc3b604788a833a81befaaab06`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:48:33.983904 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-76a5d83f-be5b-4ad1-9845-b103376ff24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:48:34.069980 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 675/1315] 10.222.0.15 () {58 vars in 1060 bytes} [Sun Sep 18 00:48:33 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:48:34.080078 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4adc686-9beb-4fe3-8b87-fe368062a9ef None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:48:34.081613 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-f4adc686-9beb-4fe3-8b87-fe368062a9ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:48:34.259842 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4adc686-9beb-4fe3-8b87-fe368062a9ef None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:48:34.371351 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:48:34.373770 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef421e-e102-403d-b06a-a50f9cec8100 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e46cfbc3b604788a833a81befaaab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:48:34.374483 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef421e-e102-403d-b06a-a50f9cec8100 service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:48:34.374778 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef421e-e102-403d-b06a-a50f9cec8100 service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:48:34.375411 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef421e-e102-403d-b06a-a50f9cec8100 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:48:34.377734 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-ddef421e-e102-403d-b06a-a50f9cec8100 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:48:34.514436 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddef421e-e102-403d-b06a-a50f9cec8100 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:48:34.516029 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddef421e-e102-403d-b06a-a50f9cec8100 service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:48:34.539789 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 641/1316] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:48:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 18 00:48:37.653606 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f61c19-40b3-4653-9dd1-f10b4ef749cd None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:48:37.654169 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f61c19-40b3-4653-9dd1-f10b4ef749cd None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:48:37.654169 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f61c19-40b3-4653-9dd1-f10b4ef749cd None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:48:37.655509 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 676/1317] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:48:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:48:37.662124 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0bdf1-7db4-4353-96af-970591742308 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:48:37.662607 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0bdf1-7db4-4353-96af-970591742308 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:48:37.662742 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0bdf1-7db4-4353-96af-970591742308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:48:37.733715 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-27c0bdf1-7db4-4353-96af-970591742308 None None] MFA Rules not processed for user `1c01447d95d54e7ba8fab62b6917c9ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:48:37.734974 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-27c0bdf1-7db4-4353-96af-970591742308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:48:37.795209 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:48:37.847273 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 642/1318] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:48:37 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:48:38.136718 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f61c19-40b3-4653-9dd1-f10b4ef749cd None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:48:38.138397 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-a8f61c19-40b3-4653-9dd1-f10b4ef749cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:48:38.252534 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f61c19-40b3-4653-9dd1-f10b4ef749cd None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:48:38.255474 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:48:38.328057 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d156d3-2343-4e24-99de-9b9fcca260c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e46cfbc3b604788a833a81befaaab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:48:38.328724 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d156d3-2343-4e24-99de-9b9fcca260c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:48:38.329019 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d156d3-2343-4e24-99de-9b9fcca260c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:48:38.329279 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d156d3-2343-4e24-99de-9b9fcca260c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:48:38.330893 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-94d156d3-2343-4e24-99de-9b9fcca260c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:48:38.441669 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d156d3-2343-4e24-99de-9b9fcca260c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:48:38.443107 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d156d3-2343-4e24-99de-9b9fcca260c6 service neutron] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:48:38.462684 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 677/1319] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:48:38 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 00:48:41.217340 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af5250-8f46-4a0d-8499-368c7d4edaa7 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:48:41.217794 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af5250-8f46-4a0d-8499-368c7d4edaa7 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:48:41.218008 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af5250-8f46-4a0d-8499-368c7d4edaa7 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:48:41.219913 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 643/1320] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:48:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:48:41.225301 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b486b-428e-4484-9688-ef30c42b0837 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:48:41.225873 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b486b-428e-4484-9688-ef30c42b0837 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:48:41.225873 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b486b-428e-4484-9688-ef30c42b0837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:48:41.266896 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:48:41.292090 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-0f8b486b-428e-4484-9688-ef30c42b0837 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:48:41.293296 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-0f8b486b-428e-4484-9688-ef30c42b0837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:48:41.388833 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 678/1321] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:48:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:48:41.671269 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af5250-8f46-4a0d-8499-368c7d4edaa7 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:48:41.672933 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-e7af5250-8f46-4a0d-8499-368c7d4edaa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:48:41.776876 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af5250-8f46-4a0d-8499-368c7d4edaa7 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:48:41.849907 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a09b1-1ba3-46ad-80da-97481e11f69b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e46cfbc3b604788a833a81befaaab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:48:41.850511 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a09b1-1ba3-46ad-80da-97481e11f69b service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:48:41.850793 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a09b1-1ba3-46ad-80da-97481e11f69b service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:48:41.851062 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a09b1-1ba3-46ad-80da-97481e11f69b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:48:41.852701 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-8f1a09b1-1ba3-46ad-80da-97481e11f69b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:48:41.859672 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:48:41.962232 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a09b1-1ba3-46ad-80da-97481e11f69b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:48:41.963683 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a09b1-1ba3-46ad-80da-97481e11f69b service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:48:41.984233 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 644/1322] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:48:41 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 00:48:44.861001 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcee542-915f-4aea-9e97-564aeb9d28a3 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:48:44.861540 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcee542-915f-4aea-9e97-564aeb9d28a3 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:48:44.861540 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcee542-915f-4aea-9e97-564aeb9d28a3 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:48:44.862842 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 679/1323] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:48:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:48:44.868305 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed82fc-9a9d-4b10-8511-c5f35efdbaca None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:48:44.868807 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed82fc-9a9d-4b10-8511-c5f35efdbaca None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:48:44.868969 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed82fc-9a9d-4b10-8511-c5f35efdbaca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:48:44.943918 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-b4ed82fc-9a9d-4b10-8511-c5f35efdbaca None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:48:44.945152 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-b4ed82fc-9a9d-4b10-8511-c5f35efdbaca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:48:45.009246 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:48:45.054720 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 645/1324] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:48:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:48:45.336022 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcee542-915f-4aea-9e97-564aeb9d28a3 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:48:45.337628 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-2dcee542-915f-4aea-9e97-564aeb9d28a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:48:45.443440 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcee542-915f-4aea-9e97-564aeb9d28a3 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:48:45.456955 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:48:45.522206 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9420a0-9fa5-4caf-ba16-ccfe3e2c741b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e46cfbc3b604788a833a81befaaab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:48:45.522818 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9420a0-9fa5-4caf-ba16-ccfe3e2c741b service neutron] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:48:45.523101 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9420a0-9fa5-4caf-ba16-ccfe3e2c741b service neutron] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:48:45.523372 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9420a0-9fa5-4caf-ba16-ccfe3e2c741b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:48:45.525022 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-8d9420a0-9fa5-4caf-ba16-ccfe3e2c741b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:48:45.645652 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9420a0-9fa5-4caf-ba16-ccfe3e2c741b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:48:45.647091 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9420a0-9fa5-4caf-ba16-ccfe3e2c741b service neutron] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:48:45.666302 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 680/1325] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:48:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 00:48:48.029194 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c60061-6bf6-479b-a117-1ce4862d1747 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:48:48.029765 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c60061-6bf6-479b-a117-1ce4862d1747 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:48:48.029765 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c60061-6bf6-479b-a117-1ce4862d1747 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:48:48.031254 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 646/1326] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:48:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:48:48.037204 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490126d0-0b74-4be8-97b1-9073a54ddcb9 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:48:48.037697 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490126d0-0b74-4be8-97b1-9073a54ddcb9 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:48:48.037846 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490126d0-0b74-4be8-97b1-9073a54ddcb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:48:48.092059 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:48:48.114625 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-490126d0-0b74-4be8-97b1-9073a54ddcb9 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:48:48.115842 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-490126d0-0b74-4be8-97b1-9073a54ddcb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:48:48.245509 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 681/1327] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:48:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:48:48.536293 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c60061-6bf6-479b-a117-1ce4862d1747 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:48:48.537881 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-68c60061-6bf6-479b-a117-1ce4862d1747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:48:48.653767 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c60061-6bf6-479b-a117-1ce4862d1747 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:48:48.731736 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d019b48-d5fc-4693-bc32-df9cb685454e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e46cfbc3b604788a833a81befaaab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:48:48.732314 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d019b48-d5fc-4693-bc32-df9cb685454e service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:48:48.732596 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d019b48-d5fc-4693-bc32-df9cb685454e service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:48:48.732873 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d019b48-d5fc-4693-bc32-df9cb685454e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:48:48.735090 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-1d019b48-d5fc-4693-bc32-df9cb685454e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:48:48.752864 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:48:48.854131 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d019b48-d5fc-4693-bc32-df9cb685454e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:48:48.855620 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d019b48-d5fc-4693-bc32-df9cb685454e service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:48:48.874400 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 647/1328] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:48:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 00:48:51.204347 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6a7a6-4395-4da1-ab69-4b9a9346c0be None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:48:51.204927 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6a7a6-4395-4da1-ab69-4b9a9346c0be None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:48:51.204927 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6a7a6-4395-4da1-ab69-4b9a9346c0be None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:48:51.207307 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 682/1329] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:48:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:48:51.215433 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d7c58-463a-44c7-b938-8c8f65979c93 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:48:51.216040 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d7c58-463a-44c7-b938-8c8f65979c93 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:48:51.216040 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d7c58-463a-44c7-b938-8c8f65979c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:48:51.294882 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-223d7c58-463a-44c7-b938-8c8f65979c93 None None] MFA Rules not processed for user `1c01447d95d54e7ba8fab62b6917c9ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:48:51.296127 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-223d7c58-463a-44c7-b938-8c8f65979c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:48:51.367808 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:48:51.409732 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 648/1330] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:48:51 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:48:51.700600 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db6a7a6-4395-4da1-ab69-4b9a9346c0be None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:48:51.702214 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-0db6a7a6-4395-4da1-ab69-4b9a9346c0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:48:51.825106 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db6a7a6-4395-4da1-ab69-4b9a9346c0be None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:48:51.849453 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:48:51.914235 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a6b80c-15b2-4163-8f36-6fbb30817515 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e46cfbc3b604788a833a81befaaab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:48:51.914864 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6b80c-15b2-4163-8f36-6fbb30817515 service neutron] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:48:51.915144 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6b80c-15b2-4163-8f36-6fbb30817515 service neutron] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:48:51.915417 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6b80c-15b2-4163-8f36-6fbb30817515 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:48:51.917991 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-d1a6b80c-15b2-4163-8f36-6fbb30817515 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:48:52.076470 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a6b80c-15b2-4163-8f36-6fbb30817515 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:48:52.077951 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a6b80c-15b2-4163-8f36-6fbb30817515 service neutron] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:48:52.101524 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 683/1331] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:48:51 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 00:48:54.536402 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b08fa-6da7-4d4e-be26-b2e7e9860b5c None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:48:54.536959 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b08fa-6da7-4d4e-be26-b2e7e9860b5c None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:48:54.536959 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b08fa-6da7-4d4e-be26-b2e7e9860b5c None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:48:54.538277 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 649/1332] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:48:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:48:54.543553 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed18e87-9156-431a-8887-db5f48730701 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:48:54.544071 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed18e87-9156-431a-8887-db5f48730701 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:48:54.544257 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed18e87-9156-431a-8887-db5f48730701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:48:54.609174 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:48:54.613260 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-4ed18e87-9156-431a-8887-db5f48730701 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:48:54.615138 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-4ed18e87-9156-431a-8887-db5f48730701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:48:54.723775 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 684/1333] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:48:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:48:55.009118 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b08fa-6da7-4d4e-be26-b2e7e9860b5c None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:48:55.010694 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-167b08fa-6da7-4d4e-be26-b2e7e9860b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:48:55.130663 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b08fa-6da7-4d4e-be26-b2e7e9860b5c None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:48:55.208763 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cca119-63d7-46cc-a24b-6e53ce31a427 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e46cfbc3b604788a833a81befaaab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:48:55.209398 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cca119-63d7-46cc-a24b-6e53ce31a427 service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:48:55.209680 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cca119-63d7-46cc-a24b-6e53ce31a427 service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:48:55.209957 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cca119-63d7-46cc-a24b-6e53ce31a427 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:48:55.211631 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-97cca119-63d7-46cc-a24b-6e53ce31a427 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:48:55.241915 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:48:55.332584 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cca119-63d7-46cc-a24b-6e53ce31a427 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:48:55.333952 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cca119-63d7-46cc-a24b-6e53ce31a427 service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:48:55.352382 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 650/1334] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:48:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 00:48:57.639032 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f5e94-8f2b-4534-9e6b-e0caa3ac285e None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:48:57.639639 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f5e94-8f2b-4534-9e6b-e0caa3ac285e None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:48:57.639639 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f5e94-8f2b-4534-9e6b-e0caa3ac285e None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:48:57.640937 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 685/1335] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:48:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 18 00:48:57.646470 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b496dcf-9b4f-46c4-ab43-f3f1d20ecd91 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:48:57.646918 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b496dcf-9b4f-46c4-ab43-f3f1d20ecd91 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:48:57.647016 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b496dcf-9b4f-46c4-ab43-f3f1d20ecd91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:48:57.712864 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-3b496dcf-9b4f-46c4-ab43-f3f1d20ecd91 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:48:57.714068 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-3b496dcf-9b4f-46c4-ab43-f3f1d20ecd91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:48:57.788293 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:48:57.811250 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 651/1336] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:48:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:48:58.102042 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479f5e94-8f2b-4534-9e6b-e0caa3ac285e None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:48:58.103597 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-479f5e94-8f2b-4534-9e6b-e0caa3ac285e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:48:58.221142 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479f5e94-8f2b-4534-9e6b-e0caa3ac285e None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:48:58.250610 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:48:58.298437 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf166c2a-84ab-4f8e-b7c7-eea56f9e1789 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e46cfbc3b604788a833a81befaaab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:48:58.299055 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf166c2a-84ab-4f8e-b7c7-eea56f9e1789 service neutron] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:48:58.299344 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf166c2a-84ab-4f8e-b7c7-eea56f9e1789 service neutron] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:48:58.299618 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf166c2a-84ab-4f8e-b7c7-eea56f9e1789 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:48:58.301311 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-bf166c2a-84ab-4f8e-b7c7-eea56f9e1789 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:48:58.418951 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf166c2a-84ab-4f8e-b7c7-eea56f9e1789 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:48:58.420455 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf166c2a-84ab-4f8e-b7c7-eea56f9e1789 service neutron] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:48:58.442471 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 686/1337] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:48:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 00:49:01.277323 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df70f2a-eb44-4c9e-a7b9-4d6bd9f4b145 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:49:01.277853 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df70f2a-eb44-4c9e-a7b9-4d6bd9f4b145 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:49:01.277853 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df70f2a-eb44-4c9e-a7b9-4d6bd9f4b145 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:49:01.279141 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 652/1338] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:49:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:49:01.284946 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad204a-551b-4eaf-b232-3043cdadcfb8 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:49:01.285379 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad204a-551b-4eaf-b232-3043cdadcfb8 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:49:01.285490 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad204a-551b-4eaf-b232-3043cdadcfb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:49:01.353892 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-39ad204a-551b-4eaf-b232-3043cdadcfb8 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:49:01.355115 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-39ad204a-551b-4eaf-b232-3043cdadcfb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:49:01.364327 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:49:01.454033 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 687/1339] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:49:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:49:01.740848 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df70f2a-eb44-4c9e-a7b9-4d6bd9f4b145 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:49:01.742400 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-2df70f2a-eb44-4c9e-a7b9-4d6bd9f4b145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:49:01.854850 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df70f2a-eb44-4c9e-a7b9-4d6bd9f4b145 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:49:01.928635 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217c288-7874-4060-90fb-4820317254e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e46cfbc3b604788a833a81befaaab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:49:01.929245 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217c288-7874-4060-90fb-4820317254e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:49:01.929534 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217c288-7874-4060-90fb-4820317254e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:49:01.929790 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217c288-7874-4060-90fb-4820317254e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:49:01.931382 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-0217c288-7874-4060-90fb-4820317254e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:49:01.967143 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:49:02.042536 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0217c288-7874-4060-90fb-4820317254e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:49:02.043924 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0217c288-7874-4060-90fb-4820317254e6 service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:49:02.062421 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 653/1340] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:49:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 00:49:06.269953 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358dfb9e-9665-4fa4-a780-da798ee8480b None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:49:06.270511 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358dfb9e-9665-4fa4-a780-da798ee8480b None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:49:06.270511 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358dfb9e-9665-4fa4-a780-da798ee8480b None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:49:06.272211 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 688/1341] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:49:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:49:06.278120 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd9d4d-5802-4d75-b35a-bec95a4c587c None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:49:06.278865 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd9d4d-5802-4d75-b35a-bec95a4c587c None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:49:06.278865 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd9d4d-5802-4d75-b35a-bec95a4c587c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:49:06.356168 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-9ecd9d4d-5802-4d75-b35a-bec95a4c587c None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:49:06.357768 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-9ecd9d4d-5802-4d75-b35a-bec95a4c587c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:49:06.463520 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:49:06.478785 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 654/1342] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:49:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 00:49:06.774841 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358dfb9e-9665-4fa4-a780-da798ee8480b None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:49:06.776419 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-358dfb9e-9665-4fa4-a780-da798ee8480b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:49:06.884877 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358dfb9e-9665-4fa4-a780-da798ee8480b None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:49:06.925075 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:49:06.965737 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b3d13-625b-4531-83b4-e1c6b7b4f30b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e46cfbc3b604788a833a81befaaab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:49:06.966359 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b3d13-625b-4531-83b4-e1c6b7b4f30b service neutron] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:49:06.966640 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b3d13-625b-4531-83b4-e1c6b7b4f30b service neutron] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:49:06.966948 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b3d13-625b-4531-83b4-e1c6b7b4f30b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:49:06.968635 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-268b3d13-625b-4531-83b4-e1c6b7b4f30b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:49:07.086934 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b3d13-625b-4531-83b4-e1c6b7b4f30b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:49:07.088329 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b3d13-625b-4531-83b4-e1c6b7b4f30b service neutron] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:49:07.107727 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 689/1343] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:49:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 00:49:10.146030 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135cc9fe-e861-4777-af3a-f7ee0dc43bf3 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:49:10.146534 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135cc9fe-e861-4777-af3a-f7ee0dc43bf3 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:49:10.146534 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135cc9fe-e861-4777-af3a-f7ee0dc43bf3 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:49:10.147825 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 655/1344] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:49:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:49:10.154320 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44048326-ffd3-47a0-aa5a-f3c9e03f9089 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:49:10.154862 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44048326-ffd3-47a0-aa5a-f3c9e03f9089 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:49:10.155311 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44048326-ffd3-47a0-aa5a-f3c9e03f9089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:49:10.230596 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-44048326-ffd3-47a0-aa5a-f3c9e03f9089 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:49:10.231827 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-44048326-ffd3-47a0-aa5a-f3c9e03f9089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:49:10.260949 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:49:10.379290 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 690/1345] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:49:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:49:10.684790 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135cc9fe-e861-4777-af3a-f7ee0dc43bf3 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:49:10.686675 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-135cc9fe-e861-4777-af3a-f7ee0dc43bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:49:10.818142 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135cc9fe-e861-4777-af3a-f7ee0dc43bf3 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:49:10.902203 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aa2d78-bb44-4975-81b4-2269aa1c9f29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e46cfbc3b604788a833a81befaaab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:49:10.902814 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa2d78-bb44-4975-81b4-2269aa1c9f29 service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:49:10.903099 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa2d78-bb44-4975-81b4-2269aa1c9f29 service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:49:10.903485 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa2d78-bb44-4975-81b4-2269aa1c9f29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:49:10.905079 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-b6aa2d78-bb44-4975-81b4-2269aa1c9f29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:49:10.966977 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:49:11.086555 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aa2d78-bb44-4975-81b4-2269aa1c9f29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:49:11.089199 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aa2d78-bb44-4975-81b4-2269aa1c9f29 service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:49:11.121750 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 656/1346] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:49:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 00:49:15.601336 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd55389f-7bb1-446a-b70f-d3c1c7838d03 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:49:15.601870 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd55389f-7bb1-446a-b70f-d3c1c7838d03 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:49:15.602019 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd55389f-7bb1-446a-b70f-d3c1c7838d03 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:49:15.603824 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 691/1347] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:49:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:49:15.610325 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb96d34-ea15-4c20-ad4b-5cae2f8da1d6 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:49:15.610916 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb96d34-ea15-4c20-ad4b-5cae2f8da1d6 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:49:15.611099 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb96d34-ea15-4c20-ad4b-5cae2f8da1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:49:15.698092 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-acb96d34-ea15-4c20-ad4b-5cae2f8da1d6 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:49:15.699941 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-acb96d34-ea15-4c20-ad4b-5cae2f8da1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:49:15.814253 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:49:15.816812 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 657/1348] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:49:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 00:49:16.101747 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd55389f-7bb1-446a-b70f-d3c1c7838d03 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:49:16.103308 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-cd55389f-7bb1-446a-b70f-d3c1c7838d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:49:16.221778 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd55389f-7bb1-446a-b70f-d3c1c7838d03 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:49:16.274127 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:49:16.301551 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73adb8c7-0912-44f8-990f-d5b6800191a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e46cfbc3b604788a833a81befaaab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:49:16.302295 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73adb8c7-0912-44f8-990f-d5b6800191a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:49:16.302667 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73adb8c7-0912-44f8-990f-d5b6800191a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:49:16.303061 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73adb8c7-0912-44f8-990f-d5b6800191a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:49:16.304918 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-73adb8c7-0912-44f8-990f-d5b6800191a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:49:16.426645 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73adb8c7-0912-44f8-990f-d5b6800191a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:49:16.428134 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73adb8c7-0912-44f8-990f-d5b6800191a2 service neutron] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:49:16.447576 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 692/1349] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:49:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 00:49:21.749717 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcdfd8a-e06d-4119-89e9-30009d843f76 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:49:21.751204 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcdfd8a-e06d-4119-89e9-30009d843f76 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:49:21.751684 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcdfd8a-e06d-4119-89e9-30009d843f76 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:49:21.754080 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 658/1350] 10.222.0.15 () {54 vars in 921 bytes} [Sun Sep 18 00:49:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:49:21.760451 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738efdd2-f8fb-4de9-a33c-a35f0a88f1dd None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:49:21.760987 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738efdd2-f8fb-4de9-a33c-a35f0a88f1dd None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:49:21.760987 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738efdd2-f8fb-4de9-a33c-a35f0a88f1dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:49:21.887459 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-738efdd2-f8fb-4de9-a33c-a35f0a88f1dd None None] MFA Rules not processed for user `7239e730ee034affb6bdf27e106c49cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:49:21.890687 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-738efdd2-f8fb-4de9-a33c-a35f0a88f1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:49:21.915823 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:49:22.045078 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 693/1351] 10.222.0.15 () {58 vars in 1018 bytes} [Sun Sep 18 00:49:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:49:26.806308 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a4cb8-657b-4315-a2ae-0448a01802a2 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:49:26.807073 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a4cb8-657b-4315-a2ae-0448a01802a2 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:49:26.807073 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a4cb8-657b-4315-a2ae-0448a01802a2 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:49:26.810033 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 659/1352] 10.222.0.15 () {54 vars in 921 bytes} [Sun Sep 18 00:49:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:49:26.818261 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b50435-1bf3-4b81-86e0-0f97b5667d30 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:49:26.819640 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b50435-1bf3-4b81-86e0-0f97b5667d30 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:49:26.820649 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b50435-1bf3-4b81-86e0-0f97b5667d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:49:26.981320 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-a9b50435-1bf3-4b81-86e0-0f97b5667d30 None None] MFA Rules not processed for user `7239e730ee034affb6bdf27e106c49cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:49:26.983053 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-a9b50435-1bf3-4b81-86e0-0f97b5667d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:49:27.126608 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:49:27.201851 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 694/1353] 10.222.0.15 () {58 vars in 1018 bytes} [Sun Sep 18 00:49:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:49:28.504117 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a39c07-eaae-41fb-bb4d-3f21777af68f None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:49:28.505399 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a39c07-eaae-41fb-bb4d-3f21777af68f None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:49:28.505876 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a39c07-eaae-41fb-bb4d-3f21777af68f None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:49:28.508341 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 660/1354] 10.222.0.15 () {54 vars in 921 bytes} [Sun Sep 18 00:49:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:49:28.515768 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ba3e4-a95f-4a6f-8bb8-dde42f90a7d9 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:49:28.516653 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ba3e4-a95f-4a6f-8bb8-dde42f90a7d9 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:49:28.516653 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ba3e4-a95f-4a6f-8bb8-dde42f90a7d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:49:28.654808 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-a67ba3e4-a95f-4a6f-8bb8-dde42f90a7d9 None None] MFA Rules not processed for user `7239e730ee034affb6bdf27e106c49cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:49:28.657404 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-a67ba3e4-a95f-4a6f-8bb8-dde42f90a7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:49:28.850947 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 695/1355] 10.222.0.15 () {58 vars in 1018 bytes} [Sun Sep 18 00:49:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 00:49:32.805821 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d27e53e-1fe4-46bc-9834-e1010695a3a9 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:49:32.806480 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d27e53e-1fe4-46bc-9834-e1010695a3a9 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:49:32.806480 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d27e53e-1fe4-46bc-9834-e1010695a3a9 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:49:32.807793 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 661/1356] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:49:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:49:32.815325 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a0617-fe50-49f8-b4b9-9bc994bdc496 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:49:32.816029 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a0617-fe50-49f8-b4b9-9bc994bdc496 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:49:32.816029 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a0617-fe50-49f8-b4b9-9bc994bdc496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:49:32.867086 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:49:32.901253 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-732a0617-fe50-49f8-b4b9-9bc994bdc496 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:49:32.902486 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-732a0617-fe50-49f8-b4b9-9bc994bdc496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:49:33.063553 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 696/1357] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:49:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 00:49:33.508183 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed17f7-56ee-44ff-b693-c09362619d41 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:49:33.508999 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed17f7-56ee-44ff-b693-c09362619d41 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:49:33.509536 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed17f7-56ee-44ff-b693-c09362619d41 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:49:33.512255 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 662/1358] 10.222.0.15 () {54 vars in 965 bytes} [Sun Sep 18 00:49:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:49:33.523713 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e638428-8725-42d1-b008-e4c721dbaf26 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:49:33.524065 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e638428-8725-42d1-b008-e4c721dbaf26 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:49:33.524299 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e638428-8725-42d1-b008-e4c721dbaf26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:49:33.631639 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-5e638428-8725-42d1-b008-e4c721dbaf26 None None] MFA Rules not processed for user `264c183fff8a49478eea4aceea73273e`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:49:33.633517 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-5e638428-8725-42d1-b008-e4c721dbaf26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:49:33.735490 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:49:33.843302 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 697/1359] 10.222.0.15 () {58 vars in 1062 bytes} [Sun Sep 18 00:49:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:49:33.855846 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed17f7-56ee-44ff-b693-c09362619d41 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:49:33.857595 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-a7ed17f7-56ee-44ff-b693-c09362619d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:49:34.025090 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ed17f7-56ee-44ff-b693-c09362619d41 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:49:34.107602 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:49:34.163566 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36104c1f-5676-47a7-a902-d8594b7a2d2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264c183fff8a49478eea4aceea73273e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:49:34.164891 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36104c1f-5676-47a7-a902-d8594b7a2d2e service nova] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:49:34.165799 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36104c1f-5676-47a7-a902-d8594b7a2d2e service nova] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:49:34.165799 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36104c1f-5676-47a7-a902-d8594b7a2d2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:49:34.167281 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-36104c1f-5676-47a7-a902-d8594b7a2d2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:49:34.278150 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36104c1f-5676-47a7-a902-d8594b7a2d2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:49:34.279724 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36104c1f-5676-47a7-a902-d8594b7a2d2e service nova] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:49:34.300979 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 663/1360] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:49:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 00:49:36.808080 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629646ae-a071-4550-87c5-1bd1207fd7a0 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:49:36.808747 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629646ae-a071-4550-87c5-1bd1207fd7a0 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:49:36.808747 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629646ae-a071-4550-87c5-1bd1207fd7a0 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:49:36.809896 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 698/1361] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:49:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:49:36.816267 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be18dde-9060-435c-9616-724ee3f570e3 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:49:36.816926 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be18dde-9060-435c-9616-724ee3f570e3 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:49:36.816926 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be18dde-9060-435c-9616-724ee3f570e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:49:36.947860 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-5be18dde-9060-435c-9616-724ee3f570e3 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:49:36.949055 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-5be18dde-9060-435c-9616-724ee3f570e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:49:37.005264 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:49:37.100669 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 664/1362] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:49:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 00:49:37.396143 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629646ae-a071-4550-87c5-1bd1207fd7a0 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:49:37.397684 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-629646ae-a071-4550-87c5-1bd1207fd7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:49:37.618128 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629646ae-a071-4550-87c5-1bd1207fd7a0 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:49:37.639580 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:49:37.820699 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861f512a-f54c-4ec0-96ea-6e4f9088d52f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264c183fff8a49478eea4aceea73273e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:49:37.821348 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f512a-f54c-4ec0-96ea-6e4f9088d52f service nova] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:49:37.821617 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f512a-f54c-4ec0-96ea-6e4f9088d52f service nova] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:49:37.821883 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f512a-f54c-4ec0-96ea-6e4f9088d52f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:49:37.823512 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-861f512a-f54c-4ec0-96ea-6e4f9088d52f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:49:37.920813 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861f512a-f54c-4ec0-96ea-6e4f9088d52f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:49:37.922933 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861f512a-f54c-4ec0-96ea-6e4f9088d52f service nova] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:49:37.943123 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 699/1363] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:49:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 18 00:49:40.581821 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6ede4-fa4e-435b-a04e-43d5657022d8 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:49:40.582356 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6ede4-fa4e-435b-a04e-43d5657022d8 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:49:40.582356 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6ede4-fa4e-435b-a04e-43d5657022d8 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:49:40.584034 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 665/1364] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:49:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:49:40.589546 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb8bca-10d7-46a6-97bf-9b07a5dd8a7e None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:49:40.590092 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb8bca-10d7-46a6-97bf-9b07a5dd8a7e None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:49:40.590092 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb8bca-10d7-46a6-97bf-9b07a5dd8a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:49:40.607049 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:49:40.669419 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-95cb8bca-10d7-46a6-97bf-9b07a5dd8a7e None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:49:40.670907 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-95cb8bca-10d7-46a6-97bf-9b07a5dd8a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:49:40.794010 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 700/1365] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:49:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 00:49:41.182355 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c469a0-23b2-4589-84fc-84178ab17c8a None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:49:41.182643 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c469a0-23b2-4589-84fc-84178ab17c8a None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:49:41.183052 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c469a0-23b2-4589-84fc-84178ab17c8a None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:49:41.184751 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 666/1366] 10.222.0.15 () {54 vars in 965 bytes} [Sun Sep 18 00:49:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:49:41.190408 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c2172-2a72-4da5-9df7-b825a9a89c62 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:49:41.190895 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c2172-2a72-4da5-9df7-b825a9a89c62 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:49:41.191712 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c2172-2a72-4da5-9df7-b825a9a89c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:49:41.284089 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-ba3c2172-2a72-4da5-9df7-b825a9a89c62 None None] MFA Rules not processed for user `264c183fff8a49478eea4aceea73273e`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:49:41.285659 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-ba3c2172-2a72-4da5-9df7-b825a9a89c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:49:41.336597 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:49:41.512502 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 701/1367] 10.222.0.15 () {58 vars in 1062 bytes} [Sun Sep 18 00:49:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 00:49:41.523601 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c469a0-23b2-4589-84fc-84178ab17c8a None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:49:41.526433 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-97c469a0-23b2-4589-84fc-84178ab17c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:49:41.801482 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c469a0-23b2-4589-84fc-84178ab17c8a None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:49:41.828129 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:49:42.016110 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf380d4-2b37-4c82-8445-5aee8f0340d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264c183fff8a49478eea4aceea73273e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:49:42.017198 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf380d4-2b37-4c82-8445-5aee8f0340d6 service nova] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:49:42.017701 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf380d4-2b37-4c82-8445-5aee8f0340d6 service nova] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:49:42.018208 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf380d4-2b37-4c82-8445-5aee8f0340d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:49:42.021666 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-caf380d4-2b37-4c82-8445-5aee8f0340d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:49:42.160992 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf380d4-2b37-4c82-8445-5aee8f0340d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:49:42.162924 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf380d4-2b37-4c82-8445-5aee8f0340d6 service nova] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:49:42.185202 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 667/1368] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:49:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 662 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 00:49:42.229926 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66403c4f-d985-422f-8357-2943fc7f427f None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:49:42.230864 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66403c4f-d985-422f-8357-2943fc7f427f None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:49:42.230864 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66403c4f-d985-422f-8357-2943fc7f427f None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:49:42.231849 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 702/1369] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:49:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 18 00:49:42.238674 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb46e6a-7e0f-49b4-bb43-2de87b7fff7d None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:49:42.239293 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb46e6a-7e0f-49b4-bb43-2de87b7fff7d None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:49:42.240135 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb46e6a-7e0f-49b4-bb43-2de87b7fff7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:49:42.291826 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:49:42.344081 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-abb46e6a-7e0f-49b4-bb43-2de87b7fff7d None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:49:42.346041 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-abb46e6a-7e0f-49b4-bb43-2de87b7fff7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:49:42.553042 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 668/1370] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:49:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 00:49:42.867753 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d4851-97b3-4260-8166-a3af4141d135 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:49:42.867991 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d4851-97b3-4260-8166-a3af4141d135 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:49:42.868327 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d4851-97b3-4260-8166-a3af4141d135 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:49:42.870153 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 703/1371] 10.222.0.15 () {54 vars in 964 bytes} [Sun Sep 18 00:49:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:49:42.876767 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8572c4-93ef-4a97-b31d-6aa7d188ccda None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:49:42.877268 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8572c4-93ef-4a97-b31d-6aa7d188ccda None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:49:42.877502 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8572c4-93ef-4a97-b31d-6aa7d188ccda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:49:42.988614 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-3f8572c4-93ef-4a97-b31d-6aa7d188ccda None None] MFA Rules not processed for user `6dbec16b81004ad3b4563ccc83d85c69`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:49:42.989841 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-3f8572c4-93ef-4a97-b31d-6aa7d188ccda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:49:43.052165 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:49:43.089028 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 669/1372] 10.222.0.15 () {58 vars in 1061 bytes} [Sun Sep 18 00:49:42 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:49:43.096854 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d4851-97b3-4260-8166-a3af4141d135 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:49:43.098336 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-d16d4851-97b3-4260-8166-a3af4141d135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:49:43.232521 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d4851-97b3-4260-8166-a3af4141d135 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:49:43.285839 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:49:43.326769 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db6fc1-6b29-42e4-83ca-fcd747ba1e7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbec16b81004ad3b4563ccc83d85c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:49:43.327309 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db6fc1-6b29-42e4-83ca-fcd747ba1e7d service cinder] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:49:43.327591 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db6fc1-6b29-42e4-83ca-fcd747ba1e7d service cinder] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:49:43.328056 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db6fc1-6b29-42e4-83ca-fcd747ba1e7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:49:43.330274 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-a8db6fc1-6b29-42e4-83ca-fcd747ba1e7d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:49:43.473923 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8db6fc1-6b29-42e4-83ca-fcd747ba1e7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:49:43.475407 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8db6fc1-6b29-42e4-83ca-fcd747ba1e7d service cinder] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:49:43.496004 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 704/1373] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:49:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 00:49:44.894714 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b0c6b3-beb7-40a7-aab7-a55a5fa5d301 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:49:44.895250 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b0c6b3-beb7-40a7-aab7-a55a5fa5d301 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:49:44.895250 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b0c6b3-beb7-40a7-aab7-a55a5fa5d301 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:49:44.896715 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 670/1374] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:49:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:49:44.902659 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8bd57-b253-4b52-9ab4-7fe8bc3141df None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:49:44.903217 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8bd57-b253-4b52-9ab4-7fe8bc3141df None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:49:44.903217 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8bd57-b253-4b52-9ab4-7fe8bc3141df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:49:44.981912 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-fca8bd57-b253-4b52-9ab4-7fe8bc3141df None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:49:44.983335 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-fca8bd57-b253-4b52-9ab4-7fe8bc3141df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:49:45.007538 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:49:45.123402 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 705/1375] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:49:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:49:45.421429 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b0c6b3-beb7-40a7-aab7-a55a5fa5d301 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:49:45.423568 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-41b0c6b3-beb7-40a7-aab7-a55a5fa5d301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:49:45.648903 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b0c6b3-beb7-40a7-aab7-a55a5fa5d301 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:49:45.717068 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:49:45.795868 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd737083-79c1-430c-8f3c-d397c83327be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264c183fff8a49478eea4aceea73273e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:49:45.796617 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd737083-79c1-430c-8f3c-d397c83327be service nova] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:49:45.796982 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd737083-79c1-430c-8f3c-d397c83327be service nova] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:49:45.797517 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd737083-79c1-430c-8f3c-d397c83327be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:49:45.799999 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-fd737083-79c1-430c-8f3c-d397c83327be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:49:45.911189 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd737083-79c1-430c-8f3c-d397c83327be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:49:45.913123 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd737083-79c1-430c-8f3c-d397c83327be service nova] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:49:45.934513 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 671/1376] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:49:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 18 00:49:48.367403 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b544519-3f34-4348-b312-d3437e303a63 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:49:48.368278 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b544519-3f34-4348-b312-d3437e303a63 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:49:48.368278 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b544519-3f34-4348-b312-d3437e303a63 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:49:48.369640 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 706/1377] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:49:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 18 00:49:48.375445 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4233c6a-1a94-4422-b764-ad22a5566ac8 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:49:48.376290 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4233c6a-1a94-4422-b764-ad22a5566ac8 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:49:48.376290 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4233c6a-1a94-4422-b764-ad22a5566ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:49:48.479105 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-d4233c6a-1a94-4422-b764-ad22a5566ac8 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:49:48.481497 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-d4233c6a-1a94-4422-b764-ad22a5566ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:49:48.490923 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:49:48.612038 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 672/1378] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:49:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 00:49:48.905838 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b544519-3f34-4348-b312-d3437e303a63 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:49:48.907875 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-6b544519-3f34-4348-b312-d3437e303a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:49:49.081418 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b544519-3f34-4348-b312-d3437e303a63 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:49:49.085617 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:49:49.210621 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b9ad19-ff56-4a8d-a3e2-7d9697bc3a9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264c183fff8a49478eea4aceea73273e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:49:49.211237 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9ad19-ff56-4a8d-a3e2-7d9697bc3a9b service nova] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:49:49.211524 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9ad19-ff56-4a8d-a3e2-7d9697bc3a9b service nova] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:49:49.211956 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9ad19-ff56-4a8d-a3e2-7d9697bc3a9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:49:49.213583 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-59b9ad19-ff56-4a8d-a3e2-7d9697bc3a9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:49:49.324855 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b9ad19-ff56-4a8d-a3e2-7d9697bc3a9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:49:49.326569 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b9ad19-ff56-4a8d-a3e2-7d9697bc3a9b service nova] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:49:49.349370 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 707/1379] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:49:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 00:49:51.742660 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69814b-c4da-4785-b8c7-959e922e894f None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:49:51.743199 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69814b-c4da-4785-b8c7-959e922e894f None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:49:51.743308 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69814b-c4da-4785-b8c7-959e922e894f None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:49:51.744718 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 673/1380] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:49:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:49:51.750675 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a329fe-6654-4299-b96e-2b7077a95a61 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:49:51.751198 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a329fe-6654-4299-b96e-2b7077a95a61 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:49:51.751294 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a329fe-6654-4299-b96e-2b7077a95a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:49:51.762793 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:49:51.827165 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-79a329fe-6654-4299-b96e-2b7077a95a61 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:49:51.829106 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-79a329fe-6654-4299-b96e-2b7077a95a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:49:51.953637 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 708/1381] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:49:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:49:52.287125 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c69814b-c4da-4785-b8c7-959e922e894f None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:49:52.290020 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-7c69814b-c4da-4785-b8c7-959e922e894f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:49:52.466842 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:49:52.483136 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c69814b-c4da-4785-b8c7-959e922e894f None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:49:52.637394 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111ba1e-7197-4272-90af-5ebd344b92d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264c183fff8a49478eea4aceea73273e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:49:52.637936 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111ba1e-7197-4272-90af-5ebd344b92d6 service nova] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:49:52.638221 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111ba1e-7197-4272-90af-5ebd344b92d6 service nova] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:49:52.638498 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111ba1e-7197-4272-90af-5ebd344b92d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:49:52.640181 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-8111ba1e-7197-4272-90af-5ebd344b92d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:49:52.800372 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8111ba1e-7197-4272-90af-5ebd344b92d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:49:52.802325 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8111ba1e-7197-4272-90af-5ebd344b92d6 service nova] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:49:52.813726 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:49:52.824401 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 674/1382] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:49:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 18 00:49:55.207100 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5ffa3-26f7-4226-826e-608b4207c2d2 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:49:55.207678 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5ffa3-26f7-4226-826e-608b4207c2d2 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:49:55.207678 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5ffa3-26f7-4226-826e-608b4207c2d2 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:49:55.209077 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 709/1383] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:49:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:49:55.215019 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a252f-d6a8-40c2-af91-13fd78eda4d1 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:49:55.215588 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a252f-d6a8-40c2-af91-13fd78eda4d1 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:49:55.215711 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a252f-d6a8-40c2-af91-13fd78eda4d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:49:55.318866 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-771a252f-d6a8-40c2-af91-13fd78eda4d1 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:49:55.320239 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-771a252f-d6a8-40c2-af91-13fd78eda4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:49:55.463660 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 675/1384] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:49:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:49:55.874538 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb5ffa3-26f7-4226-826e-608b4207c2d2 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:49:55.877148 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-4eb5ffa3-26f7-4226-826e-608b4207c2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:49:55.991975 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:49:56.110937 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb5ffa3-26f7-4226-826e-608b4207c2d2 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:49:56.276322 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc95bf-4516-4633-b456-8ee6e4f6647f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264c183fff8a49478eea4aceea73273e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:49:56.277560 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc95bf-4516-4633-b456-8ee6e4f6647f service nova] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:49:56.277560 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc95bf-4516-4633-b456-8ee6e4f6647f service nova] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:49:56.277560 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc95bf-4516-4633-b456-8ee6e4f6647f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:49:56.279319 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-67dc95bf-4516-4633-b456-8ee6e4f6647f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:49:56.349590 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:49:56.401474 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc95bf-4516-4633-b456-8ee6e4f6647f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:49:56.403587 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc95bf-4516-4633-b456-8ee6e4f6647f service nova] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:49:56.435148 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 710/1385] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:49:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 00:49:58.662557 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a27049-8036-4d3d-afc4-84544d875482 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:49:58.663183 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a27049-8036-4d3d-afc4-84544d875482 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:49:58.663183 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a27049-8036-4d3d-afc4-84544d875482 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:49:58.664986 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 676/1386] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:49:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:49:58.671539 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed553b9-2844-4c9c-94bc-6025e6fd6f68 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:49:58.672735 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed553b9-2844-4c9c-94bc-6025e6fd6f68 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:49:58.672735 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed553b9-2844-4c9c-94bc-6025e6fd6f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:49:58.756779 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-8ed553b9-2844-4c9c-94bc-6025e6fd6f68 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:49:58.757943 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-8ed553b9-2844-4c9c-94bc-6025e6fd6f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:49:58.872723 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 711/1387] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:49:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:49:59.170302 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a27049-8036-4d3d-afc4-84544d875482 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:49:59.171936 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-30a27049-8036-4d3d-afc4-84544d875482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:49:59.270999 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:49:59.357359 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a27049-8036-4d3d-afc4-84544d875482 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:49:59.497053 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7908d839-3a0d-4ebb-b6e4-337b53a10384 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264c183fff8a49478eea4aceea73273e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:49:59.497677 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908d839-3a0d-4ebb-b6e4-337b53a10384 service nova] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:49:59.497957 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908d839-3a0d-4ebb-b6e4-337b53a10384 service nova] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:49:59.498222 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908d839-3a0d-4ebb-b6e4-337b53a10384 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:49:59.499880 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-7908d839-3a0d-4ebb-b6e4-337b53a10384 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:49:59.523048 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1911c6-e7c6-4db8-a0a3-d6e9a30d44ff None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:49:59.523331 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1911c6-e7c6-4db8-a0a3-d6e9a30d44ff None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:49:59.523601 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1911c6-e7c6-4db8-a0a3-d6e9a30d44ff None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:49:59.525389 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 712/1388] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:49:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 18 00:49:59.531097 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d882ba-b26f-43bc-b370-510f42fd26fd None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:49:59.532168 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d882ba-b26f-43bc-b370-510f42fd26fd None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:49:59.532448 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d882ba-b26f-43bc-b370-510f42fd26fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:49:59.546624 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:49:59.574032 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:49:59.605686 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7908d839-3a0d-4ebb-b6e4-337b53a10384 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:49:59.607412 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7908d839-3a0d-4ebb-b6e4-337b53a10384 service nova] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:49:59.609477 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-16d882ba-b26f-43bc-b370-510f42fd26fd None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:49:59.610598 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-16d882ba-b26f-43bc-b370-510f42fd26fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:49:59.627764 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 677/1389] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:49:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 00:49:59.741077 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 713/1390] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:49:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 00:50:00.268621 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66d2c6-3685-42d0-8643-7009f7e7dfe4 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:50:00.269153 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66d2c6-3685-42d0-8643-7009f7e7dfe4 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:50:00.269315 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66d2c6-3685-42d0-8643-7009f7e7dfe4 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:50:00.270860 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 678/1391] 10.222.0.15 () {54 vars in 962 bytes} [Sun Sep 18 00:50:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:50:00.276691 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ef392-8a51-4c99-ade3-a7c97a192167 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:50:00.276986 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ef392-8a51-4c99-ade3-a7c97a192167 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:50:00.277265 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ef392-8a51-4c99-ade3-a7c97a192167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:50:00.367303 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-5a6ef392-8a51-4c99-ade3-a7c97a192167 None None] MFA Rules not processed for user `292700152741419f9f9a945f7587769a`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:50:00.369002 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-5a6ef392-8a51-4c99-ade3-a7c97a192167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:50:00.425166 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:50:00.460997 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 714/1392] 10.222.0.15 () {58 vars in 1059 bytes} [Sun Sep 18 00:50:00 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 00:50:00.470281 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c66d2c6-3685-42d0-8643-7009f7e7dfe4 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:50:00.471812 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-3c66d2c6-3685-42d0-8643-7009f7e7dfe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:50:00.588174 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c66d2c6-3685-42d0-8643-7009f7e7dfe4 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:50:00.652209 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:50:00.669905 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef1ad2c-5722-4db8-a87d-3252bf7593c3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292700152741419f9f9a945f7587769a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:50:00.670527 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1ad2c-5722-4db8-a87d-3252bf7593c3 service glance] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:50:00.670806 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1ad2c-5722-4db8-a87d-3252bf7593c3 service glance] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:50:00.671080 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1ad2c-5722-4db8-a87d-3252bf7593c3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:50:00.673387 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-fef1ad2c-5722-4db8-a87d-3252bf7593c3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:50:00.798392 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef1ad2c-5722-4db8-a87d-3252bf7593c3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:50:00.799843 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef1ad2c-5722-4db8-a87d-3252bf7593c3 service glance] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:50:00.825025 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 679/1393] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:50:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 00:50:01.678533 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d490ef-2b67-4242-8eb2-64bc766d1f22 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:50:01.679398 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d490ef-2b67-4242-8eb2-64bc766d1f22 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:50:01.679398 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d490ef-2b67-4242-8eb2-64bc766d1f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:50:01.781541 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-a4d490ef-2b67-4242-8eb2-64bc766d1f22 None None] MFA Rules not processed for user `9afbb5a9f364495ca55089dd6ddd7934`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:50:01.783548 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-a4d490ef-2b67-4242-8eb2-64bc766d1f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:50:01.909219 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 715/1394] 10.222.0.15 () {58 vars in 1009 bytes} [Sun Sep 18 00:50:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:50:01.919309 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695feb70-021e-4535-bf7a-1184694b26f9 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:50:01.919309 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695feb70-021e-4535-bf7a-1184694b26f9 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:50:01.920097 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695feb70-021e-4535-bf7a-1184694b26f9 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:50:01.920942 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 680/1395] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:50:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:50:01.927618 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641bbde-cdce-481f-9bc3-6a89c5c3eb5b None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:50:01.928563 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641bbde-cdce-481f-9bc3-6a89c5c3eb5b None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:50:01.928563 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641bbde-cdce-481f-9bc3-6a89c5c3eb5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:50:01.956469 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854f4ef-9c68-4fb2-b2ca-2dd9c4fa27b9 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:50:01.957076 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854f4ef-9c68-4fb2-b2ca-2dd9c4fa27b9 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:50:01.957572 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854f4ef-9c68-4fb2-b2ca-2dd9c4fa27b9 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:50:01.960166 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 681/1396] 10.222.0.15 () {54 vars in 943 bytes} [Sun Sep 18 00:50:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:50:01.970176 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270519fc-9ac2-45d7-be92-1532056ed1d1 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:50:01.970469 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270519fc-9ac2-45d7-be92-1532056ed1d1 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:50:01.970773 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270519fc-9ac2-45d7-be92-1532056ed1d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:50:02.018046 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-b641bbde-cdce-481f-9bc3-6a89c5c3eb5b None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:50:02.019324 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-b641bbde-cdce-481f-9bc3-6a89c5c3eb5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:50:02.035570 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:50:02.105613 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-270519fc-9ac2-45d7-be92-1532056ed1d1 None None] MFA Rules not processed for user `d0f16f1f2cb8475d9d5c752f56c4b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:50:02.107692 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-270519fc-9ac2-45d7-be92-1532056ed1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:50:02.135282 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 716/1397] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:50:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:50:02.149611 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:50:02.244117 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 682/1398] 10.222.0.15 () {58 vars in 1040 bytes} [Sun Sep 18 00:50:01 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 00:50:02.254863 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b641bbde-cdce-481f-9bc3-6a89c5c3eb5b None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:50:02.258372 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-b641bbde-cdce-481f-9bc3-6a89c5c3eb5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:50:02.377416 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b641bbde-cdce-481f-9bc3-6a89c5c3eb5b None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:50:02.426783 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:50:02.432031 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270519fc-9ac2-45d7-be92-1532056ed1d1 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:50:02.433856 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-270519fc-9ac2-45d7-be92-1532056ed1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:50:02.506441 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0dd6dd-5b1b-4f77-b8d3-f3c00fd151c1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0f16f1f2cb8475d9d5c752f56c4b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:50:02.506973 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0dd6dd-5b1b-4f77-b8d3-f3c00fd151c1 service swift] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:50:02.507257 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0dd6dd-5b1b-4f77-b8d3-f3c00fd151c1 service swift] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:50:02.507533 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0dd6dd-5b1b-4f77-b8d3-f3c00fd151c1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:50:02.509777 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-dd0dd6dd-5b1b-4f77-b8d3-f3c00fd151c1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:50:02.574132 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270519fc-9ac2-45d7-be92-1532056ed1d1 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:50:02.647041 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:50:02.727138 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0dd6dd-5b1b-4f77-b8d3-f3c00fd151c1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:50:02.729094 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0dd6dd-5b1b-4f77-b8d3-f3c00fd151c1 service swift] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:50:02.730061 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ba50f-3a12-4143-91da-48f0fcf9412f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264c183fff8a49478eea4aceea73273e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:50:02.730707 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ba50f-3a12-4143-91da-48f0fcf9412f service nova] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:50:02.731014 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ba50f-3a12-4143-91da-48f0fcf9412f service nova] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:50:02.731298 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ba50f-3a12-4143-91da-48f0fcf9412f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:50:02.733082 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-c81ba50f-3a12-4143-91da-48f0fcf9412f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:50:02.738180 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 717/1399] 10.222.0.15 () {60 vars in 1384 bytes} [Sun Sep 18 00:50:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 18 00:50:02.840627 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81ba50f-3a12-4143-91da-48f0fcf9412f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:50:02.842273 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81ba50f-3a12-4143-91da-48f0fcf9412f service nova] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:50:02.863288 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 683/1400] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:50:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 00:50:05.400560 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b697e-ef84-44ea-b699-25652ee410dc None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:50:05.401166 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b697e-ef84-44ea-b699-25652ee410dc None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:50:05.401264 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b697e-ef84-44ea-b699-25652ee410dc None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:50:05.402709 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 718/1401] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:50:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:50:05.409763 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac790c-d498-40a8-80a3-76179838caf4 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:50:05.410256 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac790c-d498-40a8-80a3-76179838caf4 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:50:05.410382 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac790c-d498-40a8-80a3-76179838caf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:50:05.497686 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-3dac790c-d498-40a8-80a3-76179838caf4 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:50:05.499609 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-3dac790c-d498-40a8-80a3-76179838caf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:50:05.512240 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:50:05.649767 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 684/1402] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:50:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:50:05.952009 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b697e-ef84-44ea-b699-25652ee410dc None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:50:05.955322 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-a99b697e-ef84-44ea-b699-25652ee410dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:50:06.079324 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:50:06.172987 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b697e-ef84-44ea-b699-25652ee410dc None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:50:06.330774 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7533527f-e60a-4a6b-bc96-760fb0c2a57b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264c183fff8a49478eea4aceea73273e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:50:06.331348 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533527f-e60a-4a6b-bc96-760fb0c2a57b service nova] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:50:06.331632 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533527f-e60a-4a6b-bc96-760fb0c2a57b service nova] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:50:06.332008 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533527f-e60a-4a6b-bc96-760fb0c2a57b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:50:06.334617 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-7533527f-e60a-4a6b-bc96-760fb0c2a57b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:50:06.377745 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:50:06.448023 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7533527f-e60a-4a6b-bc96-760fb0c2a57b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:50:06.449702 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7533527f-e60a-4a6b-bc96-760fb0c2a57b service nova] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:50:06.474995 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 719/1403] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:50:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 00:50:08.973263 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3e529-0c39-4813-aa2f-b8b87f3c1b05 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:50:08.973850 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3e529-0c39-4813-aa2f-b8b87f3c1b05 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:50:08.974221 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3e529-0c39-4813-aa2f-b8b87f3c1b05 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:50:08.976723 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 685/1404] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:50:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:50:08.987077 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df16c6-c114-4949-a8f6-7225b4386984 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:50:08.988093 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df16c6-c114-4949-a8f6-7225b4386984 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:50:08.988589 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df16c6-c114-4949-a8f6-7225b4386984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:50:09.105409 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-07df16c6-c114-4949-a8f6-7225b4386984 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:50:09.106841 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-07df16c6-c114-4949-a8f6-7225b4386984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:50:09.261523 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 720/1405] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:50:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:50:09.624667 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb3e529-0c39-4813-aa2f-b8b87f3c1b05 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:50:09.627410 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-7eb3e529-0c39-4813-aa2f-b8b87f3c1b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:50:09.858883 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:50:09.873830 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb3e529-0c39-4813-aa2f-b8b87f3c1b05 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:50:10.080004 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba981c19-d9be-429f-9b41-f2209a1e5868 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264c183fff8a49478eea4aceea73273e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:50:10.081106 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba981c19-d9be-429f-9b41-f2209a1e5868 service nova] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:50:10.081106 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba981c19-d9be-429f-9b41-f2209a1e5868 service nova] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:50:10.081392 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba981c19-d9be-429f-9b41-f2209a1e5868 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:50:10.082826 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-ba981c19-d9be-429f-9b41-f2209a1e5868 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:50:10.222281 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba981c19-d9be-429f-9b41-f2209a1e5868 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:50:10.223948 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba981c19-d9be-429f-9b41-f2209a1e5868 service nova] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:50:10.241558 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:50:10.248150 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 686/1406] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:50:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 624 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 00:50:12.615130 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd03e7e-3e07-4fc1-a4a7-518085dd1b56 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:50:12.615725 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd03e7e-3e07-4fc1-a4a7-518085dd1b56 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:50:12.615725 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd03e7e-3e07-4fc1-a4a7-518085dd1b56 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:50:12.620714 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 721/1407] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:50:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:50:12.624261 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ae191-c905-4e87-8f1a-572d8f48ab9a None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:50:12.625126 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ae191-c905-4e87-8f1a-572d8f48ab9a None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:50:12.625825 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ae191-c905-4e87-8f1a-572d8f48ab9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:50:12.742943 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-aa9ae191-c905-4e87-8f1a-572d8f48ab9a None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:50:12.744516 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-aa9ae191-c905-4e87-8f1a-572d8f48ab9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:50:12.892403 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 687/1408] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:50:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:50:13.183777 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd03e7e-3e07-4fc1-a4a7-518085dd1b56 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:50:13.185338 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-7cd03e7e-3e07-4fc1-a4a7-518085dd1b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:50:13.200616 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:50:13.446374 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd03e7e-3e07-4fc1-a4a7-518085dd1b56 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:50:13.651243 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:50:13.690581 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff2cfe7-a112-4f8c-86c7-158f80ac2d5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264c183fff8a49478eea4aceea73273e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:50:13.690581 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2cfe7-a112-4f8c-86c7-158f80ac2d5c service nova] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:50:13.690581 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2cfe7-a112-4f8c-86c7-158f80ac2d5c service nova] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:50:13.690581 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2cfe7-a112-4f8c-86c7-158f80ac2d5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:50:13.691512 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-3ff2cfe7-a112-4f8c-86c7-158f80ac2d5c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:50:13.833886 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff2cfe7-a112-4f8c-86c7-158f80ac2d5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:50:13.837559 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff2cfe7-a112-4f8c-86c7-158f80ac2d5c service nova] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:50:13.874004 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 722/1409] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:50:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 690 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 00:50:22.889804 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=66 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:50:23.868904 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=56 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:50:26.621145 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0b2c1-8453-471e-94f5-da7fc5acd030 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:50:26.621728 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0b2c1-8453-471e-94f5-da7fc5acd030 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:50:26.621728 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0b2c1-8453-471e-94f5-da7fc5acd030 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:50:26.623053 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 688/1410] 10.222.0.15 () {54 vars in 918 bytes} [Sun Sep 18 00:50:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:50:26.629016 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccebef68-4cac-4c77-a937-f539372e9d31 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:50:26.629446 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccebef68-4cac-4c77-a937-f539372e9d31 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:50:26.629582 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccebef68-4cac-4c77-a937-f539372e9d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:50:26.713516 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-ccebef68-4cac-4c77-a937-f539372e9d31 None None] MFA Rules not processed for user `7239e730ee034affb6bdf27e106c49cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:50:26.714767 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-ccebef68-4cac-4c77-a937-f539372e9d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:50:26.828601 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 723/1411] 10.222.0.15 () {58 vars in 1015 bytes} [Sun Sep 18 00:50:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:50:26.843401 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391a1b8-10a7-458e-a579-a757959b8113 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:50:26.843687 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391a1b8-10a7-458e-a579-a757959b8113 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:50:26.843995 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391a1b8-10a7-458e-a579-a757959b8113 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:50:26.845367 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 689/1412] 10.222.0.15 () {54 vars in 918 bytes} [Sun Sep 18 00:50:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:50:26.850407 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b869d-76ea-4e0e-9673-fe23ba512738 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:50:26.850697 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b869d-76ea-4e0e-9673-fe23ba512738 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:50:26.850975 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b869d-76ea-4e0e-9673-fe23ba512738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:50:26.929637 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:50:26.933282 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-216b869d-76ea-4e0e-9673-fe23ba512738 None None] MFA Rules not processed for user `264c183fff8a49478eea4aceea73273e`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:50:26.935151 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-216b869d-76ea-4e0e-9673-fe23ba512738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:50:27.072604 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 724/1413] 10.222.0.15 () {58 vars in 1015 bytes} [Sun Sep 18 00:50:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:50:29.721542 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a124125-0145-4ec4-a49b-95c2468cb9f6 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:50:29.722127 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a124125-0145-4ec4-a49b-95c2468cb9f6 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:50:29.722127 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a124125-0145-4ec4-a49b-95c2468cb9f6 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:50:29.723468 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 690/1414] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 18 00:50:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:50:29.728841 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3ed54-57bf-414d-a381-4f840de73d67 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:50:29.729263 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3ed54-57bf-414d-a381-4f840de73d67 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:50:29.729392 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3ed54-57bf-414d-a381-4f840de73d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:50:29.796961 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-c3d3ed54-57bf-414d-a381-4f840de73d67 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:50:29.798183 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-c3d3ed54-57bf-414d-a381-4f840de73d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:50:29.852928 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:50:29.896131 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 725/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 18 00:50:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:50:30.193417 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a124125-0145-4ec4-a49b-95c2468cb9f6 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:50:30.195024 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-4a124125-0145-4ec4-a49b-95c2468cb9f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:50:30.341625 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a124125-0145-4ec4-a49b-95c2468cb9f6 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:50:30.419265 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:50:30.461880 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157c7e83-1b82-4038-ad1f-605c20808444 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264c183fff8a49478eea4aceea73273e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:50:30.462403 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c7e83-1b82-4038-ad1f-605c20808444 service nova] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:50:30.462684 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c7e83-1b82-4038-ad1f-605c20808444 service nova] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:50:30.462958 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c7e83-1b82-4038-ad1f-605c20808444 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:50:30.464597 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-157c7e83-1b82-4038-ad1f-605c20808444 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:50:30.561281 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157c7e83-1b82-4038-ad1f-605c20808444 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:50:30.563501 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157c7e83-1b82-4038-ad1f-605c20808444 service nova] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:50:30.584227 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 691/1416] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:50:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 00:50:31.752972 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb76022-2c0e-41f6-807f-a03988cb7f8b None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:50:31.753734 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb76022-2c0e-41f6-807f-a03988cb7f8b None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:50:31.753734 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb76022-2c0e-41f6-807f-a03988cb7f8b None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:50:31.754882 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 726/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 18 00:50:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:50:31.761400 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df390978-19c9-433b-9736-94e907a9f283 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:50:31.761906 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df390978-19c9-433b-9736-94e907a9f283 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:50:31.762001 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df390978-19c9-433b-9736-94e907a9f283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:50:31.839624 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-df390978-19c9-433b-9736-94e907a9f283 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:50:31.840870 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-df390978-19c9-433b-9736-94e907a9f283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:50:31.868612 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:50:31.939348 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 692/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 18 00:50:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:50:32.095563 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb76022-2c0e-41f6-807f-a03988cb7f8b None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:50:32.097002 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-6cb76022-2c0e-41f6-807f-a03988cb7f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:50:32.260451 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb76022-2c0e-41f6-807f-a03988cb7f8b None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:50:32.308138 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:50:32.396327 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec38421e-3d4f-4a84-ba99-4259401cb780 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264c183fff8a49478eea4aceea73273e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:50:32.396959 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec38421e-3d4f-4a84-ba99-4259401cb780 service nova] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:50:32.397237 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec38421e-3d4f-4a84-ba99-4259401cb780 service nova] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:50:32.397513 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec38421e-3d4f-4a84-ba99-4259401cb780 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:50:32.399233 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-ec38421e-3d4f-4a84-ba99-4259401cb780 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:50:32.506010 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec38421e-3d4f-4a84-ba99-4259401cb780 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:50:32.507679 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec38421e-3d4f-4a84-ba99-4259401cb780 service nova] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:50:32.525964 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 727/1419] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:50:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 00:50:33.667513 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48adc49e-b538-4554-ac7f-f4335963932e None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:50:33.668086 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48adc49e-b538-4554-ac7f-f4335963932e None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:50:33.668086 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48adc49e-b538-4554-ac7f-f4335963932e None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:50:33.669440 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 693/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 18 00:50:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:50:33.676376 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96930a9c-93ea-4eb1-9561-d649dd423717 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:50:33.676889 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96930a9c-93ea-4eb1-9561-d649dd423717 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:50:33.677227 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96930a9c-93ea-4eb1-9561-d649dd423717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:50:33.732159 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:50:33.874073 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-96930a9c-93ea-4eb1-9561-d649dd423717 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:50:33.875850 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-96930a9c-93ea-4eb1-9561-d649dd423717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:50:33.974923 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 728/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 18 00:50:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:50:34.140682 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48adc49e-b538-4554-ac7f-f4335963932e None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:50:34.142257 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-48adc49e-b538-4554-ac7f-f4335963932e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:50:34.291732 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48adc49e-b538-4554-ac7f-f4335963932e None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:50:34.304959 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:50:34.425911 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f4df39-419f-453c-af4f-908bab413e49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264c183fff8a49478eea4aceea73273e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:50:34.426521 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4df39-419f-453c-af4f-908bab413e49 service nova] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:50:34.426799 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4df39-419f-453c-af4f-908bab413e49 service nova] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:50:34.427073 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4df39-419f-453c-af4f-908bab413e49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:50:34.428727 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-45f4df39-419f-453c-af4f-908bab413e49 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:50:34.521036 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f4df39-419f-453c-af4f-908bab413e49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:50:34.522643 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f4df39-419f-453c-af4f-908bab413e49 service nova] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:50:34.541438 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 694/1422] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:50:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 00:50:35.681933 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc2517-1f8e-487a-8330-9bf3ca4e527f None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:50:35.682470 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc2517-1f8e-487a-8330-9bf3ca4e527f None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:50:35.682470 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc2517-1f8e-487a-8330-9bf3ca4e527f None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:50:35.683832 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 729/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 18 00:50:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:50:35.690265 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ceea3f-75ac-4981-87b8-830195ad336b None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:50:35.690719 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ceea3f-75ac-4981-87b8-830195ad336b None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:50:35.690814 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ceea3f-75ac-4981-87b8-830195ad336b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:50:35.710991 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:50:35.767953 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-f4ceea3f-75ac-4981-87b8-830195ad336b None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:50:35.769157 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-f4ceea3f-75ac-4981-87b8-830195ad336b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:50:35.870236 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 695/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 18 00:50:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:50:36.018671 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc2517-1f8e-487a-8330-9bf3ca4e527f None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:50:36.020147 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-e3bc2517-1f8e-487a-8330-9bf3ca4e527f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:50:36.137889 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:50:36.175192 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc2517-1f8e-487a-8330-9bf3ca4e527f None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:50:36.288652 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb8ae38-5c79-443b-be07-7edccf3b6e44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264c183fff8a49478eea4aceea73273e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:50:36.289174 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8ae38-5c79-443b-be07-7edccf3b6e44 service nova] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:50:36.289702 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8ae38-5c79-443b-be07-7edccf3b6e44 service nova] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:50:36.289965 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8ae38-5c79-443b-be07-7edccf3b6e44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:50:36.291574 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-2eb8ae38-5c79-443b-be07-7edccf3b6e44 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:50:36.372971 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:50:36.387542 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb8ae38-5c79-443b-be07-7edccf3b6e44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:50:36.389191 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb8ae38-5c79-443b-be07-7edccf3b6e44 service nova] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:50:36.410534 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 730/1425] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:50:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 00:50:37.536973 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a41bf-2708-49e5-9418-f1eeae6e12b0 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:50:37.537529 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a41bf-2708-49e5-9418-f1eeae6e12b0 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:50:37.537529 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a41bf-2708-49e5-9418-f1eeae6e12b0 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:50:37.538907 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 696/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 18 00:50:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:50:37.545782 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2765186a-f9f4-4c12-9ceb-87ed5011108e None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:50:37.546266 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2765186a-f9f4-4c12-9ceb-87ed5011108e None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:50:37.546373 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2765186a-f9f4-4c12-9ceb-87ed5011108e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:50:37.623668 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-2765186a-f9f4-4c12-9ceb-87ed5011108e None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:50:37.624580 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-2765186a-f9f4-4c12-9ceb-87ed5011108e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:50:37.719993 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 731/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 18 00:50:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:50:37.868792 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a41bf-2708-49e5-9418-f1eeae6e12b0 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:50:37.870319 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-4d7a41bf-2708-49e5-9418-f1eeae6e12b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:50:37.955394 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:50:38.017918 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a41bf-2708-49e5-9418-f1eeae6e12b0 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:50:38.135320 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb693fc0-914a-484c-911f-64124192011f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264c183fff8a49478eea4aceea73273e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:50:38.136241 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb693fc0-914a-484c-911f-64124192011f service nova] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:50:38.136532 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb693fc0-914a-484c-911f-64124192011f service nova] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:50:38.136806 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb693fc0-914a-484c-911f-64124192011f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:50:38.138414 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-bb693fc0-914a-484c-911f-64124192011f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:50:38.188735 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:50:38.230431 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb693fc0-914a-484c-911f-64124192011f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:50:38.232076 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb693fc0-914a-484c-911f-64124192011f service nova] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:50:38.252540 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 697/1428] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:50:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 00:50:39.338169 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f32c3-341d-4b96-9d52-e276c476a5ca None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:50:39.338717 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f32c3-341d-4b96-9d52-e276c476a5ca None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:50:39.338717 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f32c3-341d-4b96-9d52-e276c476a5ca None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:50:39.340153 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 732/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 18 00:50:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:50:39.346631 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df266867-90e5-4b68-b3dd-b4c47d8418c3 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:50:39.347114 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df266867-90e5-4b68-b3dd-b4c47d8418c3 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:50:39.347209 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df266867-90e5-4b68-b3dd-b4c47d8418c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:50:39.428516 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-df266867-90e5-4b68-b3dd-b4c47d8418c3 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:50:39.430303 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-df266867-90e5-4b68-b3dd-b4c47d8418c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:50:39.552582 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 698/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 18 00:50:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:50:39.704045 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f32c3-341d-4b96-9d52-e276c476a5ca None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:50:39.705623 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-354f32c3-341d-4b96-9d52-e276c476a5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:50:39.755276 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:50:39.858559 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f32c3-341d-4b96-9d52-e276c476a5ca None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:50:39.972729 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4f3424-7927-422d-a36a-dd650a248969 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264c183fff8a49478eea4aceea73273e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:50:39.973248 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4f3424-7927-422d-a36a-dd650a248969 service nova] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:50:39.973524 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4f3424-7927-422d-a36a-dd650a248969 service nova] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:50:39.973792 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4f3424-7927-422d-a36a-dd650a248969 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:50:39.975384 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-1f4f3424-7927-422d-a36a-dd650a248969 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:50:39.982487 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:50:40.072311 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4f3424-7927-422d-a36a-dd650a248969 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:50:40.073931 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4f3424-7927-422d-a36a-dd650a248969 service nova] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:50:40.092143 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 733/1431] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:50:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 00:50:41.178441 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7632603-e81c-4921-9ad9-0bfdc3e2a494 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:50:41.179013 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7632603-e81c-4921-9ad9-0bfdc3e2a494 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:50:41.179013 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7632603-e81c-4921-9ad9-0bfdc3e2a494 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:50:41.180394 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 699/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 18 00:50:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:50:41.186841 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55aa35-3265-44e2-b173-9fdeb5d78e61 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:50:41.187380 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55aa35-3265-44e2-b173-9fdeb5d78e61 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:50:41.187380 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55aa35-3265-44e2-b173-9fdeb5d78e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:50:41.264485 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-0e55aa35-3265-44e2-b173-9fdeb5d78e61 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:50:41.266184 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-0e55aa35-3265-44e2-b173-9fdeb5d78e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:50:41.335126 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:50:41.365629 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 734/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 18 00:50:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:50:41.516396 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7632603-e81c-4921-9ad9-0bfdc3e2a494 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:50:41.517913 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-f7632603-e81c-4921-9ad9-0bfdc3e2a494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:50:41.536289 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:50:41.668243 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7632603-e81c-4921-9ad9-0bfdc3e2a494 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:50:41.757324 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:50:41.783945 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0b1ecb-ffe0-43fc-bd00-c97ce920be20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264c183fff8a49478eea4aceea73273e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:50:41.784553 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b1ecb-ffe0-43fc-bd00-c97ce920be20 service nova] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:50:41.784834 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b1ecb-ffe0-43fc-bd00-c97ce920be20 service nova] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:50:41.785108 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b1ecb-ffe0-43fc-bd00-c97ce920be20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:50:41.786712 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-cf0b1ecb-ffe0-43fc-bd00-c97ce920be20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:50:41.886436 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0b1ecb-ffe0-43fc-bd00-c97ce920be20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:50:41.888089 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0b1ecb-ffe0-43fc-bd00-c97ce920be20 service nova] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:50:41.907205 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 700/1434] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:50:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 00:50:42.988496 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e57ee1-0a94-4a8f-a07f-1c7c0f8790b2 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:50:42.989059 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e57ee1-0a94-4a8f-a07f-1c7c0f8790b2 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:50:42.989059 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e57ee1-0a94-4a8f-a07f-1c7c0f8790b2 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:50:42.990419 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 735/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 18 00:50:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:50:42.997305 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8b463-1132-4e11-ad81-9b6c66a6d19c None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:50:42.997837 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8b463-1132-4e11-ad81-9b6c66a6d19c None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:50:42.997837 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8b463-1132-4e11-ad81-9b6c66a6d19c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:50:43.076076 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-63b8b463-1132-4e11-ad81-9b6c66a6d19c None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:50:43.077285 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-63b8b463-1132-4e11-ad81-9b6c66a6d19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:50:43.119281 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:50:43.180705 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 701/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 18 00:50:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:50:43.332151 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e57ee1-0a94-4a8f-a07f-1c7c0f8790b2 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:50:43.333949 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-63e57ee1-0a94-4a8f-a07f-1c7c0f8790b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:50:43.486057 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e57ee1-0a94-4a8f-a07f-1c7c0f8790b2 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:50:43.543860 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:50:43.604961 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aee5901-edb2-41a2-b696-87f39c0758ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264c183fff8a49478eea4aceea73273e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:50:43.605486 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee5901-edb2-41a2-b696-87f39c0758ab service nova] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:50:43.605767 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee5901-edb2-41a2-b696-87f39c0758ab service nova] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:50:43.606036 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee5901-edb2-41a2-b696-87f39c0758ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:50:43.607638 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-1aee5901-edb2-41a2-b696-87f39c0758ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:50:43.699236 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aee5901-edb2-41a2-b696-87f39c0758ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:50:43.700850 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aee5901-edb2-41a2-b696-87f39c0758ab service nova] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:50:43.719305 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 736/1437] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:50:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 00:50:44.788515 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7074d3-0400-4d19-af52-e29707c5b1cc None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:50:44.789095 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7074d3-0400-4d19-af52-e29707c5b1cc None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:50:44.789095 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7074d3-0400-4d19-af52-e29707c5b1cc None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:50:44.790650 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 702/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 18 00:50:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:50:44.797132 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0503008f-946b-47de-bf3a-1bab599fc412 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:50:44.797602 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0503008f-946b-47de-bf3a-1bab599fc412 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:50:44.797698 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0503008f-946b-47de-bf3a-1bab599fc412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:50:44.874763 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-0503008f-946b-47de-bf3a-1bab599fc412 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:50:44.876029 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-0503008f-946b-47de-bf3a-1bab599fc412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:50:44.878094 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:50:44.974091 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 737/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 18 00:50:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:50:45.123809 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7074d3-0400-4d19-af52-e29707c5b1cc None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:50:45.125818 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-bd7074d3-0400-4d19-af52-e29707c5b1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:50:45.271655 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7074d3-0400-4d19-af52-e29707c5b1cc None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:50:45.301271 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:50:45.386821 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0eee86-6213-48cd-b2d2-bf6e9a8c24aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264c183fff8a49478eea4aceea73273e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:50:45.387342 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0eee86-6213-48cd-b2d2-bf6e9a8c24aa service nova] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:50:45.387620 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0eee86-6213-48cd-b2d2-bf6e9a8c24aa service nova] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:50:45.387931 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0eee86-6213-48cd-b2d2-bf6e9a8c24aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:50:45.389596 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-ec0eee86-6213-48cd-b2d2-bf6e9a8c24aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:50:45.483120 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0eee86-6213-48cd-b2d2-bf6e9a8c24aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:50:45.484867 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0eee86-6213-48cd-b2d2-bf6e9a8c24aa service nova] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:50:45.505324 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 703/1440] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:50:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 00:50:47.631311 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c40317-ffde-4361-b2a4-3d2775fb0209 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:50:47.631917 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c40317-ffde-4361-b2a4-3d2775fb0209 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:50:47.631917 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c40317-ffde-4361-b2a4-3d2775fb0209 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:50:47.633467 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 738/1441] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 18 00:50:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:50:47.639369 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953cc94-69fb-49be-97b1-7d6158c8c5cc None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:50:47.639857 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953cc94-69fb-49be-97b1-7d6158c8c5cc None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:50:47.639990 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953cc94-69fb-49be-97b1-7d6158c8c5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:50:47.682933 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:50:47.710893 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-b953cc94-69fb-49be-97b1-7d6158c8c5cc None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:50:47.712176 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-b953cc94-69fb-49be-97b1-7d6158c8c5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:50:47.810206 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 704/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 18 00:50:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:50:48.112108 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c40317-ffde-4361-b2a4-3d2775fb0209 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:50:48.113647 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-b6c40317-ffde-4361-b2a4-3d2775fb0209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:50:48.234474 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c40317-ffde-4361-b2a4-3d2775fb0209 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:50:48.269169 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:50:48.318805 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb400adb-6f55-4397-b0d1-5a34afb0630c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e46cfbc3b604788a833a81befaaab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:50:48.319453 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb400adb-6f55-4397-b0d1-5a34afb0630c service neutron] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:50:48.319731 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb400adb-6f55-4397-b0d1-5a34afb0630c service neutron] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:50:48.320037 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb400adb-6f55-4397-b0d1-5a34afb0630c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:50:48.321710 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-cb400adb-6f55-4397-b0d1-5a34afb0630c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:50:48.439973 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb400adb-6f55-4397-b0d1-5a34afb0630c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:50:48.441420 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb400adb-6f55-4397-b0d1-5a34afb0630c service neutron] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:50:48.459529 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 739/1443] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:50:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 00:50:50.775468 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51167b-18db-4e2b-bc5e-325a31c7a680 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:50:50.776034 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51167b-18db-4e2b-bc5e-325a31c7a680 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:50:50.776034 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51167b-18db-4e2b-bc5e-325a31c7a680 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:50:50.777326 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 705/1444] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 18 00:50:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:50:50.782622 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f464525-1d0c-471d-82aa-b443a1759712 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:50:50.783046 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f464525-1d0c-471d-82aa-b443a1759712 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:50:50.783154 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f464525-1d0c-471d-82aa-b443a1759712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:50:50.852997 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-0f464525-1d0c-471d-82aa-b443a1759712 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:50:50.854227 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-0f464525-1d0c-471d-82aa-b443a1759712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:50:50.867828 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:50:50.971607 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 740/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 18 00:50:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:50:51.256845 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff51167b-18db-4e2b-bc5e-325a31c7a680 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:50:51.258401 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-ff51167b-18db-4e2b-bc5e-325a31c7a680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:50:51.371109 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff51167b-18db-4e2b-bc5e-325a31c7a680 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:50:51.384916 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:50:51.446866 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f46d6c-1861-4726-8f75-8ffd6c23943f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e46cfbc3b604788a833a81befaaab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:50:51.447474 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f46d6c-1861-4726-8f75-8ffd6c23943f service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:50:51.447751 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f46d6c-1861-4726-8f75-8ffd6c23943f service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:50:51.448057 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f46d6c-1861-4726-8f75-8ffd6c23943f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:50:51.449637 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-77f46d6c-1861-4726-8f75-8ffd6c23943f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:50:51.563198 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f46d6c-1861-4726-8f75-8ffd6c23943f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:50:51.564668 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f46d6c-1861-4726-8f75-8ffd6c23943f service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:50:51.587214 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 706/1446] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:50:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 00:50:54.156362 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa02d1a3-2450-46d4-bd45-f79762d1696f None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:50:54.156911 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa02d1a3-2450-46d4-bd45-f79762d1696f None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:50:54.156911 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa02d1a3-2450-46d4-bd45-f79762d1696f None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:50:54.158305 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 741/1447] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 18 00:50:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:50:54.165480 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f0930-4e8c-4b16-b78d-9d9638b0ce2a None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:50:54.165958 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f0930-4e8c-4b16-b78d-9d9638b0ce2a None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:50:54.166052 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f0930-4e8c-4b16-b78d-9d9638b0ce2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:50:54.219547 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:50:54.243095 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-f92f0930-4e8c-4b16-b78d-9d9638b0ce2a None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:50:54.244367 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-f92f0930-4e8c-4b16-b78d-9d9638b0ce2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:50:54.377120 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 707/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 18 00:50:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:50:54.675585 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa02d1a3-2450-46d4-bd45-f79762d1696f None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:50:54.677215 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-fa02d1a3-2450-46d4-bd45-f79762d1696f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:50:54.787360 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa02d1a3-2450-46d4-bd45-f79762d1696f None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:50:54.829031 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:50:54.863242 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade173c-b038-49f2-ac95-f0bc491c582e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e46cfbc3b604788a833a81befaaab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:50:54.863851 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade173c-b038-49f2-ac95-f0bc491c582e service neutron] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:50:54.864159 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade173c-b038-49f2-ac95-f0bc491c582e service neutron] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:50:54.864430 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade173c-b038-49f2-ac95-f0bc491c582e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:50:54.866030 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-6ade173c-b038-49f2-ac95-f0bc491c582e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:50:54.995747 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ade173c-b038-49f2-ac95-f0bc491c582e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:50:54.997277 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ade173c-b038-49f2-ac95-f0bc491c582e service neutron] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:50:55.015654 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 742/1449] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:50:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 00:50:57.346288 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd6f60-be84-4e89-a52f-0e4fd78f9a2b None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:50:57.346929 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd6f60-be84-4e89-a52f-0e4fd78f9a2b None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:50:57.346929 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd6f60-be84-4e89-a52f-0e4fd78f9a2b None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:50:57.348230 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 708/1450] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 18 00:50:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:50:57.353690 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a673f0-1afc-4aa0-aa5f-64de13b49e63 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:50:57.354190 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a673f0-1afc-4aa0-aa5f-64de13b49e63 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:50:57.354287 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a673f0-1afc-4aa0-aa5f-64de13b49e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:50:57.423496 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-a9a673f0-1afc-4aa0-aa5f-64de13b49e63 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:50:57.424755 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-a9a673f0-1afc-4aa0-aa5f-64de13b49e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:50:57.446503 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:50:57.527807 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 743/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 18 00:50:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:50:57.813214 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd6f60-be84-4e89-a52f-0e4fd78f9a2b None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:50:57.814806 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-bcbd6f60-be84-4e89-a52f-0e4fd78f9a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:50:57.919826 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd6f60-be84-4e89-a52f-0e4fd78f9a2b None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:50:57.943471 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:50:58.011628 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c2b13-3f44-427e-979e-101aae171793 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e46cfbc3b604788a833a81befaaab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:50:58.012276 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c2b13-3f44-427e-979e-101aae171793 service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:50:58.012559 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c2b13-3f44-427e-979e-101aae171793 service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:50:58.012832 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c2b13-3f44-427e-979e-101aae171793 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:50:58.014448 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-158c2b13-3f44-427e-979e-101aae171793 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:50:58.126403 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c2b13-3f44-427e-979e-101aae171793 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:50:58.127762 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c2b13-3f44-427e-979e-101aae171793 service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:50:58.146670 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 709/1452] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:50:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 18 00:51:00.406014 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aefd022-135d-45f0-8ef8-a27a0733d68c None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:51:00.407369 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aefd022-135d-45f0-8ef8-a27a0733d68c None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:51:00.407369 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aefd022-135d-45f0-8ef8-a27a0733d68c None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:51:00.407954 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 744/1453] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 18 00:51:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:51:00.414304 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9175e30-59ce-4e26-83af-81f9ae52c20d None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:51:00.414791 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9175e30-59ce-4e26-83af-81f9ae52c20d None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:51:00.415148 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9175e30-59ce-4e26-83af-81f9ae52c20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:51:00.480955 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:51:00.484388 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-b9175e30-59ce-4e26-83af-81f9ae52c20d None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:51:00.486235 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-b9175e30-59ce-4e26-83af-81f9ae52c20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:51:00.589770 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 710/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 18 00:51:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:51:00.878153 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aefd022-135d-45f0-8ef8-a27a0733d68c None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:51:00.879785 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-4aefd022-135d-45f0-8ef8-a27a0733d68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:51:00.992539 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aefd022-135d-45f0-8ef8-a27a0733d68c None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:51:01.054206 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:51:01.078654 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54537a83-6a74-41fa-b2d0-7b6b26f718d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e46cfbc3b604788a833a81befaaab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:51:01.079268 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54537a83-6a74-41fa-b2d0-7b6b26f718d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:51:01.079550 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54537a83-6a74-41fa-b2d0-7b6b26f718d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:51:01.079825 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54537a83-6a74-41fa-b2d0-7b6b26f718d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:51:01.081456 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-54537a83-6a74-41fa-b2d0-7b6b26f718d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:51:01.193078 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54537a83-6a74-41fa-b2d0-7b6b26f718d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:51:01.194656 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54537a83-6a74-41fa-b2d0-7b6b26f718d7 service neutron] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:51:01.213409 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 745/1455] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:51:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 00:51:03.453608 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b356f02-c414-4c2f-8226-aa4e0c9452ff None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:51:03.454183 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b356f02-c414-4c2f-8226-aa4e0c9452ff None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:51:03.454183 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b356f02-c414-4c2f-8226-aa4e0c9452ff None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:51:03.455558 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 711/1456] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 18 00:51:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:51:03.461007 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d144fc-d81d-4c31-871c-5cbc1a5fcac1 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:51:03.461459 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d144fc-d81d-4c31-871c-5cbc1a5fcac1 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:51:03.461563 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d144fc-d81d-4c31-871c-5cbc1a5fcac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:51:03.531370 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-79d144fc-d81d-4c31-871c-5cbc1a5fcac1 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:51:03.532654 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-79d144fc-d81d-4c31-871c-5cbc1a5fcac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:51:03.563429 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:51:03.636131 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 746/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 18 00:51:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:51:03.920402 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b356f02-c414-4c2f-8226-aa4e0c9452ff None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:51:03.922591 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-0b356f02-c414-4c2f-8226-aa4e0c9452ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:51:04.028911 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b356f02-c414-4c2f-8226-aa4e0c9452ff None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:51:04.059100 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:51:04.105537 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a1e26c-6548-455e-a8b5-93288fe3af50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e46cfbc3b604788a833a81befaaab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:51:04.106147 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1e26c-6548-455e-a8b5-93288fe3af50 service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:51:04.106431 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1e26c-6548-455e-a8b5-93288fe3af50 service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:51:04.106708 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1e26c-6548-455e-a8b5-93288fe3af50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:51:04.108350 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-49a1e26c-6548-455e-a8b5-93288fe3af50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:51:04.219202 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a1e26c-6548-455e-a8b5-93288fe3af50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:51:04.220703 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a1e26c-6548-455e-a8b5-93288fe3af50 service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:51:04.239253 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 712/1458] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:51:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 00:51:06.480246 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060291fa-1c04-4dc7-94b2-e7e6348cfd46 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:51:06.480779 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060291fa-1c04-4dc7-94b2-e7e6348cfd46 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:51:06.480779 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060291fa-1c04-4dc7-94b2-e7e6348cfd46 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:51:06.482290 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 747/1459] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 18 00:51:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:51:06.487729 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8d8c8-3353-43c7-91ee-08c54eabe602 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:51:06.488267 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8d8c8-3353-43c7-91ee-08c54eabe602 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:51:06.488374 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8d8c8-3353-43c7-91ee-08c54eabe602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:51:06.556706 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-60b8d8c8-3353-43c7-91ee-08c54eabe602 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:51:06.557926 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-60b8d8c8-3353-43c7-91ee-08c54eabe602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:51:06.566483 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:51:06.659369 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 713/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 18 00:51:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 00:51:06.946734 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060291fa-1c04-4dc7-94b2-e7e6348cfd46 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:51:06.948320 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-060291fa-1c04-4dc7-94b2-e7e6348cfd46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:51:07.076637 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060291fa-1c04-4dc7-94b2-e7e6348cfd46 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:51:07.134172 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:51:07.152623 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7142f86-e9df-4f06-9bb1-8ba647532a8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e46cfbc3b604788a833a81befaaab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:51:07.153245 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7142f86-e9df-4f06-9bb1-8ba647532a8e service neutron] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:51:07.153525 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7142f86-e9df-4f06-9bb1-8ba647532a8e service neutron] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:51:07.153800 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7142f86-e9df-4f06-9bb1-8ba647532a8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:51:07.155454 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-c7142f86-e9df-4f06-9bb1-8ba647532a8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:51:07.266257 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7142f86-e9df-4f06-9bb1-8ba647532a8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:51:07.267610 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7142f86-e9df-4f06-9bb1-8ba647532a8e service neutron] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:51:07.286236 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 748/1461] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:51:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 00:51:09.580114 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4083020-1aa8-4627-b054-f1b51d2d03d8 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:51:09.580675 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4083020-1aa8-4627-b054-f1b51d2d03d8 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:51:09.580675 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4083020-1aa8-4627-b054-f1b51d2d03d8 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:51:09.582072 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 714/1462] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 18 00:51:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:51:09.587589 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48f997-4e61-4832-9a14-feda51530bb4 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:51:09.588087 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48f997-4e61-4832-9a14-feda51530bb4 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:51:09.588200 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48f997-4e61-4832-9a14-feda51530bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:51:09.656275 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-8e48f997-4e61-4832-9a14-feda51530bb4 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:51:09.657498 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-8e48f997-4e61-4832-9a14-feda51530bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:51:09.698424 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:51:09.770396 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 749/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 18 00:51:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:51:10.070070 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4083020-1aa8-4627-b054-f1b51d2d03d8 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:51:10.071767 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-f4083020-1aa8-4627-b054-f1b51d2d03d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:51:10.194285 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4083020-1aa8-4627-b054-f1b51d2d03d8 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:51:10.231841 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:51:10.269382 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2baa955-b672-41ab-8142-13c20b0d6406 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e46cfbc3b604788a833a81befaaab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:51:10.269997 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2baa955-b672-41ab-8142-13c20b0d6406 service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:51:10.270279 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2baa955-b672-41ab-8142-13c20b0d6406 service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:51:10.270557 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2baa955-b672-41ab-8142-13c20b0d6406 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:51:10.272519 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-e2baa955-b672-41ab-8142-13c20b0d6406 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:51:10.387147 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2baa955-b672-41ab-8142-13c20b0d6406 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:51:10.388691 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2baa955-b672-41ab-8142-13c20b0d6406 service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:51:10.414907 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 715/1464] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:51:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 00:51:12.612650 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d640a5c-2c11-4ea0-b0f8-46929ddcdcfa None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:51:12.613238 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d640a5c-2c11-4ea0-b0f8-46929ddcdcfa None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:51:12.613238 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d640a5c-2c11-4ea0-b0f8-46929ddcdcfa None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:51:12.614552 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 750/1465] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 18 00:51:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:51:12.619911 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f833563-0b23-4e9d-9ca2-afc8f0bdaaea None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:51:12.620365 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f833563-0b23-4e9d-9ca2-afc8f0bdaaea None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:51:12.620460 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f833563-0b23-4e9d-9ca2-afc8f0bdaaea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:51:12.690966 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-2f833563-0b23-4e9d-9ca2-afc8f0bdaaea None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:51:12.692209 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-2f833563-0b23-4e9d-9ca2-afc8f0bdaaea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:51:12.709881 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:51:12.792810 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 716/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 18 00:51:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:51:13.078862 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d640a5c-2c11-4ea0-b0f8-46929ddcdcfa None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:51:13.080456 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-3d640a5c-2c11-4ea0-b0f8-46929ddcdcfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:51:13.187796 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d640a5c-2c11-4ea0-b0f8-46929ddcdcfa None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:51:13.255598 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:51:13.262246 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5a738c-075a-4780-a04e-0cc1f4e790eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e46cfbc3b604788a833a81befaaab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:51:13.262856 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a738c-075a-4780-a04e-0cc1f4e790eb service neutron] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:51:13.263262 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a738c-075a-4780-a04e-0cc1f4e790eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:51:13.263474 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a738c-075a-4780-a04e-0cc1f4e790eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:51:13.265081 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-4b5a738c-075a-4780-a04e-0cc1f4e790eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:51:13.375656 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5a738c-075a-4780-a04e-0cc1f4e790eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:51:13.377038 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5a738c-075a-4780-a04e-0cc1f4e790eb service neutron] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:51:13.395335 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 751/1467] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:51:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 00:51:15.586045 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75472b8-bfeb-42ce-b9ad-f240045955ae None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:51:15.586611 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75472b8-bfeb-42ce-b9ad-f240045955ae None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:51:15.586611 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75472b8-bfeb-42ce-b9ad-f240045955ae None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:51:15.588008 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 717/1468] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 18 00:51:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:51:15.593579 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b4a0c-bdda-4778-aba8-2eb20a9f4590 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:51:15.594070 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b4a0c-bdda-4778-aba8-2eb20a9f4590 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:51:15.594181 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b4a0c-bdda-4778-aba8-2eb20a9f4590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:51:15.665129 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-3f7b4a0c-bdda-4778-aba8-2eb20a9f4590 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:51:15.666514 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-3f7b4a0c-bdda-4778-aba8-2eb20a9f4590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:51:15.715911 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:51:15.765629 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 752/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 18 00:51:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:51:16.051118 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75472b8-bfeb-42ce-b9ad-f240045955ae None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:51:16.052696 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-d75472b8-bfeb-42ce-b9ad-f240045955ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:51:16.157067 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75472b8-bfeb-42ce-b9ad-f240045955ae None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:51:16.206262 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:51:16.232601 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a05863-0f9b-4db0-adf1-9a2603db2f19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e46cfbc3b604788a833a81befaaab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:51:16.233219 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a05863-0f9b-4db0-adf1-9a2603db2f19 service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:51:16.233501 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a05863-0f9b-4db0-adf1-9a2603db2f19 service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:51:16.233777 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a05863-0f9b-4db0-adf1-9a2603db2f19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:51:16.235507 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-19a05863-0f9b-4db0-adf1-9a2603db2f19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:51:16.349083 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a05863-0f9b-4db0-adf1-9a2603db2f19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:51:16.350504 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a05863-0f9b-4db0-adf1-9a2603db2f19 service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:51:16.369239 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 718/1470] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:51:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 00:51:25.763666 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=22 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:51:26.366811 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=66 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:51:36.561131 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c1df3-15d6-4a47-9726-8195c2b44951 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:51:36.562291 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c1df3-15d6-4a47-9726-8195c2b44951 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:51:36.562291 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c1df3-15d6-4a47-9726-8195c2b44951 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:51:36.563583 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 753/1471] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:51:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:51:36.568934 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552f97e-9359-424d-a2f9-ca784069c415 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:51:36.569405 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552f97e-9359-424d-a2f9-ca784069c415 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:51:36.569519 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552f97e-9359-424d-a2f9-ca784069c415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:51:36.637012 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-7552f97e-9359-424d-a2f9-ca784069c415 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:51:36.638137 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-7552f97e-9359-424d-a2f9-ca784069c415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:51:36.733701 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 719/1472] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:51:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:51:37.035021 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9917d-0139-4700-9d72-b1442e1e45dc None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:51:37.035306 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9917d-0139-4700-9d72-b1442e1e45dc None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:51:37.035581 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9917d-0139-4700-9d72-b1442e1e45dc None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:51:37.036956 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 754/1473] 10.222.0.15 () {54 vars in 962 bytes} [Sun Sep 18 00:51:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 18 00:51:37.042100 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e80bb-3660-4e80-b632-49640e9ff8d4 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:51:37.042388 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e80bb-3660-4e80-b632-49640e9ff8d4 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:51:37.042661 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e80bb-3660-4e80-b632-49640e9ff8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:51:37.120073 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-f27e80bb-3660-4e80-b632-49640e9ff8d4 None None] MFA Rules not processed for user `292700152741419f9f9a945f7587769a`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:51:37.121296 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-f27e80bb-3660-4e80-b632-49640e9ff8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:51:37.141795 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:51:37.203124 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 720/1474] 10.222.0.15 () {58 vars in 1059 bytes} [Sun Sep 18 00:51:37 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:51:37.210922 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd9917d-0139-4700-9d72-b1442e1e45dc None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:51:37.212473 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-ecd9917d-0139-4700-9d72-b1442e1e45dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:51:37.319086 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd9917d-0139-4700-9d72-b1442e1e45dc None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:51:37.408969 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa393c5-575c-48cb-a6f6-62e45ee685c6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292700152741419f9f9a945f7587769a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:51:37.409590 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa393c5-575c-48cb-a6f6-62e45ee685c6 service glance] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:51:37.409871 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa393c5-575c-48cb-a6f6-62e45ee685c6 service glance] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:51:37.410141 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa393c5-575c-48cb-a6f6-62e45ee685c6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:51:37.411854 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-baa393c5-575c-48cb-a6f6-62e45ee685c6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:51:37.468482 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:51:37.525314 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa393c5-575c-48cb-a6f6-62e45ee685c6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:51:37.526751 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa393c5-575c-48cb-a6f6-62e45ee685c6 service glance] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:51:37.546122 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 755/1475] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:51:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 00:51:39.829539 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7535cf28-ef56-4f29-9d17-1b66d096bdb5 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:51:39.830122 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7535cf28-ef56-4f29-9d17-1b66d096bdb5 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:51:39.830122 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7535cf28-ef56-4f29-9d17-1b66d096bdb5 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:51:39.831477 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 721/1476] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:51:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:51:39.836994 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280afb3-39b2-4f84-b330-64c7eee3494d None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:51:39.837446 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280afb3-39b2-4f84-b330-64c7eee3494d None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:51:39.837557 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280afb3-39b2-4f84-b330-64c7eee3494d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:51:39.903884 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-7280afb3-39b2-4f84-b330-64c7eee3494d None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:51:39.905608 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-7280afb3-39b2-4f84-b330-64c7eee3494d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:51:40.006166 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 756/1477] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:51:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:51:40.277229 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7535cf28-ef56-4f29-9d17-1b66d096bdb5 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:51:40.278784 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-7535cf28-ef56-4f29-9d17-1b66d096bdb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:51:40.414144 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7535cf28-ef56-4f29-9d17-1b66d096bdb5 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:51:40.465967 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:51:40.512381 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3fc863-1b83-4a36-bf6d-02b2fc662317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59ffbd91d29d4939bf7137c10c138592', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:51:40.512997 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3fc863-1b83-4a36-bf6d-02b2fc662317 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:51:40.513279 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3fc863-1b83-4a36-bf6d-02b2fc662317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:51:40.513551 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3fc863-1b83-4a36-bf6d-02b2fc662317 admin admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:51:40.514191 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3fc863-1b83-4a36-bf6d-02b2fc662317 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:51:40.516572 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: WARNING py.warnings [None req-3e3fc863-1b83-4a36-bf6d-02b2fc662317 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 18 00:51:40.516572 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: warnings.warn(msg) Sep 18 00:51:40.516572 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: Sep 18 00:51:40.517729 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3fc863-1b83-4a36-bf6d-02b2fc662317 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:51:40.537691 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 722/1478] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Sep 18 00:51:40 2022] GET /identity/v3/projects => generated 2553 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 00:51:42.736783 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88c072-d791-4bd1-9f0a-5a5d4c3d319a None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:51:42.737323 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88c072-d791-4bd1-9f0a-5a5d4c3d319a None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:51:42.737323 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88c072-d791-4bd1-9f0a-5a5d4c3d319a None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:51:42.738635 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 757/1479] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:51:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:51:42.743883 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0c61e-5f0a-410b-b2f6-5314a0b28327 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:51:42.744372 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0c61e-5f0a-410b-b2f6-5314a0b28327 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:51:42.744491 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0c61e-5f0a-410b-b2f6-5314a0b28327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:51:42.811924 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-11d0c61e-5f0a-410b-b2f6-5314a0b28327 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:51:42.813251 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-11d0c61e-5f0a-410b-b2f6-5314a0b28327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:51:42.909192 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 723/1480] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:51:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:51:43.204919 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d88c072-d791-4bd1-9f0a-5a5d4c3d319a None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:51:43.206479 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-1d88c072-d791-4bd1-9f0a-5a5d4c3d319a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:51:43.216503 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:51:43.356259 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d88c072-d791-4bd1-9f0a-5a5d4c3d319a None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:51:43.439279 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:51:43.473017 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1426d9b2-2aea-4169-9821-db663698fa24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264c183fff8a49478eea4aceea73273e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:51:43.473644 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426d9b2-2aea-4169-9821-db663698fa24 service nova] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:51:43.474055 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426d9b2-2aea-4169-9821-db663698fa24 service nova] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:51:43.474341 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426d9b2-2aea-4169-9821-db663698fa24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:51:43.475982 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-1426d9b2-2aea-4169-9821-db663698fa24 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:51:43.566823 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1426d9b2-2aea-4169-9821-db663698fa24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:51:43.568458 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1426d9b2-2aea-4169-9821-db663698fa24 service nova] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:51:43.586839 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 758/1481] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:51:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 18 00:51:46.001825 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0b4cf-d7df-4fcf-b0eb-76b72e49c6c7 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:51:46.002424 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0b4cf-d7df-4fcf-b0eb-76b72e49c6c7 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:51:46.002424 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0b4cf-d7df-4fcf-b0eb-76b72e49c6c7 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:51:46.003717 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 724/1482] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:51:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:51:46.009036 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10018a-7c09-4fd0-af23-9852c92f39e1 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:51:46.009481 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10018a-7c09-4fd0-af23-9852c92f39e1 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:51:46.009657 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10018a-7c09-4fd0-af23-9852c92f39e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:51:46.075720 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-4c10018a-7c09-4fd0-af23-9852c92f39e1 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:51:46.077614 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-4c10018a-7c09-4fd0-af23-9852c92f39e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:51:46.125534 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:51:46.177508 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 759/1483] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:51:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:51:46.471507 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0b4cf-d7df-4fcf-b0eb-76b72e49c6c7 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:51:46.473442 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-9fc0b4cf-d7df-4fcf-b0eb-76b72e49c6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:51:46.497420 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:51:46.579100 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0b4cf-d7df-4fcf-b0eb-76b72e49c6c7 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:51:46.654657 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc0f65-5962-4ade-8c44-6ea3cc14e870 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e46cfbc3b604788a833a81befaaab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:51:46.655312 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc0f65-5962-4ade-8c44-6ea3cc14e870 service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:51:46.655592 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc0f65-5962-4ade-8c44-6ea3cc14e870 service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:51:46.655866 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc0f65-5962-4ade-8c44-6ea3cc14e870 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:51:46.657518 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-d7fc0f65-5962-4ade-8c44-6ea3cc14e870 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:51:46.735389 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:51:46.770433 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fc0f65-5962-4ade-8c44-6ea3cc14e870 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:51:46.771924 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fc0f65-5962-4ade-8c44-6ea3cc14e870 service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:51:46.791225 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 725/1484] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:51:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 00:51:49.033512 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5e771-da8e-455e-8bfd-cd3b64212fae None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:51:49.034084 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5e771-da8e-455e-8bfd-cd3b64212fae None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:51:49.034084 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5e771-da8e-455e-8bfd-cd3b64212fae None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:51:49.035452 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 760/1485] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:51:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:51:49.041204 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b051d1-a3a6-4dd4-b7fa-9483bc3c1af2 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:51:49.041656 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b051d1-a3a6-4dd4-b7fa-9483bc3c1af2 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:51:49.041768 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b051d1-a3a6-4dd4-b7fa-9483bc3c1af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:51:49.108889 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-04b051d1-a3a6-4dd4-b7fa-9483bc3c1af2 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:51:49.110151 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-04b051d1-a3a6-4dd4-b7fa-9483bc3c1af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:51:49.210658 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 726/1486] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:51:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:51:49.504622 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f5e771-da8e-455e-8bfd-cd3b64212fae None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:51:49.506174 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-28f5e771-da8e-455e-8bfd-cd3b64212fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:51:49.612491 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f5e771-da8e-455e-8bfd-cd3b64212fae None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:51:49.684378 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:51:49.685897 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56213be-5f4c-427b-846d-c2e70bf6c0aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e46cfbc3b604788a833a81befaaab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:51:49.687196 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56213be-5f4c-427b-846d-c2e70bf6c0aa service neutron] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:51:49.687674 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56213be-5f4c-427b-846d-c2e70bf6c0aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:51:49.688196 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56213be-5f4c-427b-846d-c2e70bf6c0aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:51:49.690082 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-d56213be-5f4c-427b-846d-c2e70bf6c0aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:51:49.798506 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56213be-5f4c-427b-846d-c2e70bf6c0aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:51:49.799972 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56213be-5f4c-427b-846d-c2e70bf6c0aa service neutron] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:51:49.822514 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 761/1487] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:51:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 00:51:52.105887 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b32e3-d039-4a67-85f8-a6719246ce51 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:51:52.106536 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b32e3-d039-4a67-85f8-a6719246ce51 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:51:52.106536 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b32e3-d039-4a67-85f8-a6719246ce51 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:51:52.107960 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 727/1488] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:51:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:51:52.113984 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0cf5ec-1233-44b7-9a4a-7c762f83da3a None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:51:52.114461 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0cf5ec-1233-44b7-9a4a-7c762f83da3a None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:51:52.114564 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0cf5ec-1233-44b7-9a4a-7c762f83da3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:51:52.183931 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-3c0cf5ec-1233-44b7-9a4a-7c762f83da3a None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:51:52.185159 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-3c0cf5ec-1233-44b7-9a4a-7c762f83da3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:51:52.238261 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:51:52.283659 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 762/1489] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:51:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:51:52.574150 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b32e3-d039-4a67-85f8-a6719246ce51 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:51:52.575698 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-fb7b32e3-d039-4a67-85f8-a6719246ce51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:51:52.612814 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:51:52.682751 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b32e3-d039-4a67-85f8-a6719246ce51 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:51:52.755279 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b06470e-c4f5-4951-b058-a0e15566dfde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e46cfbc3b604788a833a81befaaab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:51:52.755802 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06470e-c4f5-4951-b058-a0e15566dfde service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:51:52.756111 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06470e-c4f5-4951-b058-a0e15566dfde service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:51:52.756384 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06470e-c4f5-4951-b058-a0e15566dfde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:51:52.757965 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-2b06470e-c4f5-4951-b058-a0e15566dfde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:51:52.844235 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:51:52.874157 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b06470e-c4f5-4951-b058-a0e15566dfde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:51:52.875612 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b06470e-c4f5-4951-b058-a0e15566dfde service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:51:52.894641 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 728/1490] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:51:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 00:51:55.340569 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a9c9c-d68e-472e-a807-a8f16e7101b1 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:51:55.341136 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a9c9c-d68e-472e-a807-a8f16e7101b1 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:51:55.341136 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a9c9c-d68e-472e-a807-a8f16e7101b1 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:51:55.343072 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 763/1491] 10.222.0.15 () {54 vars in 927 bytes} [Sun Sep 18 00:51:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:51:55.348687 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e004bf0-978c-40ed-a375-56ed5d183c85 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:51:55.349140 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e004bf0-978c-40ed-a375-56ed5d183c85 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:51:55.349257 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e004bf0-978c-40ed-a375-56ed5d183c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:51:55.419641 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-3e004bf0-978c-40ed-a375-56ed5d183c85 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:51:55.420845 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-3e004bf0-978c-40ed-a375-56ed5d183c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:51:55.521619 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 729/1492] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Sep 18 00:51:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:51:55.808794 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8a9c9c-d68e-472e-a807-a8f16e7101b1 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:51:55.810344 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-5e8a9c9c-d68e-472e-a807-a8f16e7101b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:51:55.925704 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8a9c9c-d68e-472e-a807-a8f16e7101b1 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:51:56.002865 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af2ba32-afc1-45d4-8d72-bacd0b68cf26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e46cfbc3b604788a833a81befaaab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:51:56.003480 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2ba32-afc1-45d4-8d72-bacd0b68cf26 service neutron] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:51:56.003755 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2ba32-afc1-45d4-8d72-bacd0b68cf26 service neutron] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:51:56.004055 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2ba32-afc1-45d4-8d72-bacd0b68cf26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:51:56.005867 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-3af2ba32-afc1-45d4-8d72-bacd0b68cf26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:51:56.016539 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:51:56.138864 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af2ba32-afc1-45d4-8d72-bacd0b68cf26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:51:56.140893 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af2ba32-afc1-45d4-8d72-bacd0b68cf26 service neutron] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:51:56.163687 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 764/1493] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:51:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 00:52:05.520076 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=82 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:52:06.159498 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=50 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:53:10.542133 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6967237-990a-4f34-8a7c-6a321a88589c None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:53:10.542715 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6967237-990a-4f34-8a7c-6a321a88589c None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:53:10.542715 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6967237-990a-4f34-8a7c-6a321a88589c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:53:10.618692 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-f6967237-990a-4f34-8a7c-6a321a88589c None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:53:10.619945 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-f6967237-990a-4f34-8a7c-6a321a88589c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:53:10.724758 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 730/1494] 10.222.0.15 () {58 vars in 958 bytes} [Sun Sep 18 00:53:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:53:10.733102 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2541e3-caac-4147-b760-fa32327cce9f None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:53:10.733645 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2541e3-caac-4147-b760-fa32327cce9f None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:53:10.733764 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2541e3-caac-4147-b760-fa32327cce9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:53:10.809780 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-fa2541e3-caac-4147-b760-fa32327cce9f None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:53:10.810978 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-fa2541e3-caac-4147-b760-fa32327cce9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:53:10.911508 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 765/1495] 10.222.0.15 () {58 vars in 958 bytes} [Sun Sep 18 00:53:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:53:10.916993 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6967237-990a-4f34-8a7c-6a321a88589c None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:53:10.918731 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-f6967237-990a-4f34-8a7c-6a321a88589c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:53:10.930627 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6967237-990a-4f34-8a7c-6a321a88589c None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:53:10.999644 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:53:11.040119 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037fcbf-8c99-4818-82e3-dbb3ab69c72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59ffbd91d29d4939bf7137c10c138592', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:53:11.040727 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037fcbf-8c99-4818-82e3-dbb3ab69c72a admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:53:11.041007 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037fcbf-8c99-4818-82e3-dbb3ab69c72a admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:53:11.041283 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037fcbf-8c99-4818-82e3-dbb3ab69c72a admin admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:53:11.042169 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c037fcbf-8c99-4818-82e3-dbb3ab69c72a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:53:11.042469 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c037fcbf-8c99-4818-82e3-dbb3ab69c72a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:53:11.044009 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: WARNING py.warnings [None req-c037fcbf-8c99-4818-82e3-dbb3ab69c72a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 18 00:53:11.044009 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: warnings.warn(msg) Sep 18 00:53:11.044009 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: Sep 18 00:53:11.044893 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c037fcbf-8c99-4818-82e3-dbb3ab69c72a admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:53:11.056050 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 731/1496] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Sep 18 00:53:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:53:11.065135 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2541e3-caac-4147-b760-fa32327cce9f None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:53:11.074273 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2541e3-caac-4147-b760-fa32327cce9f None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:53:11.137088 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:53:11.172650 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5745e81c-5707-441e-b486-3a29b6e464a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59ffbd91d29d4939bf7137c10c138592', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:53:11.173398 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745e81c-5707-441e-b486-3a29b6e464a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:53:11.173838 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745e81c-5707-441e-b486-3a29b6e464a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:53:11.174111 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745e81c-5707-441e-b486-3a29b6e464a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:53:11.174757 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5745e81c-5707-441e-b486-3a29b6e464a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:53:11.176603 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: WARNING py.warnings [None req-5745e81c-5707-441e-b486-3a29b6e464a4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 18 00:53:11.176603 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: warnings.warn(msg) Sep 18 00:53:11.176603 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: Sep 18 00:53:11.177757 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5745e81c-5707-441e-b486-3a29b6e464a4 admin admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:53:11.237240 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 766/1497] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Sep 18 00:53:11 2022] POST /identity/v3/projects => generated 377 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 00:53:11.241308 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037fcbf-8c99-4818-82e3-dbb3ab69c72a admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:53:11.242841 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-c037fcbf-8c99-4818-82e3-dbb3ab69c72a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:53:11.278881 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037fcbf-8c99-4818-82e3-dbb3ab69c72a admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:53:11.374070 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94fa44-baee-4f40-85a4-1e9601c751d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59ffbd91d29d4939bf7137c10c138592', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:53:11.374687 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94fa44-baee-4f40-85a4-1e9601c751d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:53:11.374965 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94fa44-baee-4f40-85a4-1e9601c751d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:53:11.375235 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94fa44-baee-4f40-85a4-1e9601c751d7 admin admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:53:11.375879 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e94fa44-baee-4f40-85a4-1e9601c751d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:53:11.376918 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: WARNING py.warnings [None req-1e94fa44-baee-4f40-85a4-1e9601c751d7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 18 00:53:11.376918 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: warnings.warn(msg) Sep 18 00:53:11.376918 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: Sep 18 00:53:11.378146 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e94fa44-baee-4f40-85a4-1e9601c751d7 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:53:11.423669 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 732/1498] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Sep 18 00:53:11 2022] POST /identity/v3/users => generated 289 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 00:53:11.428049 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5745e81c-5707-441e-b486-3a29b6e464a4 admin admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:53:11.429550 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-5745e81c-5707-441e-b486-3a29b6e464a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:53:11.492946 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5745e81c-5707-441e-b486-3a29b6e464a4 admin admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:53:11.578048 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:53:11.589442 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef6fe9-f3df-4b14-a898-8acd07150f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59ffbd91d29d4939bf7137c10c138592', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:53:11.590593 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef6fe9-f3df-4b14-a898-8acd07150f31 admin admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:53:11.590877 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef6fe9-f3df-4b14-a898-8acd07150f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:53:11.591151 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef6fe9-f3df-4b14-a898-8acd07150f31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:53:11.591789 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cef6fe9-f3df-4b14-a898-8acd07150f31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:53:11.592827 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: WARNING py.warnings [None req-5cef6fe9-f3df-4b14-a898-8acd07150f31 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 18 00:53:11.592827 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: warnings.warn(msg) Sep 18 00:53:11.592827 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: Sep 18 00:53:11.593720 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cef6fe9-f3df-4b14-a898-8acd07150f31 admin admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:53:11.606882 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 767/1499] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Sep 18 00:53:11 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 00:53:11.611036 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94fa44-baee-4f40-85a4-1e9601c751d7 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:53:11.612572 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-1e94fa44-baee-4f40-85a4-1e9601c751d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:53:11.623977 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94fa44-baee-4f40-85a4-1e9601c751d7 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:53:11.649366 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:53:11.728786 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f0bd9a-fdfb-4c78-826b-e161f5d9e527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59ffbd91d29d4939bf7137c10c138592', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:53:11.729409 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f0bd9a-fdfb-4c78-826b-e161f5d9e527 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:53:11.729687 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f0bd9a-fdfb-4c78-826b-e161f5d9e527 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:53:11.729958 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f0bd9a-fdfb-4c78-826b-e161f5d9e527 admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:53:11.730596 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f0bd9a-fdfb-4c78-826b-e161f5d9e527 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:53:11.731617 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: WARNING py.warnings [None req-25f0bd9a-fdfb-4c78-826b-e161f5d9e527 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 18 00:53:11.731617 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: warnings.warn(msg) Sep 18 00:53:11.731617 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: Sep 18 00:53:11.732540 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f0bd9a-fdfb-4c78-826b-e161f5d9e527 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:53:11.746172 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 733/1500] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Sep 18 00:53:11 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 00:53:11.750478 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef6fe9-f3df-4b14-a898-8acd07150f31 admin admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:53:11.752093 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-5cef6fe9-f3df-4b14-a898-8acd07150f31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:53:11.791421 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef6fe9-f3df-4b14-a898-8acd07150f31 admin admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:53:11.884848 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70845cc-fec7-483c-80ec-f4b11e74dc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59ffbd91d29d4939bf7137c10c138592', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:53:11.885502 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70845cc-fec7-483c-80ec-f4b11e74dc06 admin admin] REQUEST_METHOD: `PUT` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:53:11.885817 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70845cc-fec7-483c-80ec-f4b11e74dc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:53:11.886045 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70845cc-fec7-483c-80ec-f4b11e74dc06 admin admin] PATH_INFO: `/v3/projects/7e3045fdd52941c8be5ae1afba2915ff/users/99c45724ae1044d08472ec9274a9fef7/roles/59d7218a321b4c20bc1996494a48a2a1` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:53:11.909663 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70845cc-fec7-483c-80ec-f4b11e74dc06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e3045fdd52941c8be5ae1afba2915ff, user_id=99c45724ae1044d08472ec9274a9fef7, role_id=59d7218a321b4c20bc1996494a48a2a1)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:53:11.910687 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: WARNING py.warnings [None req-d70845cc-fec7-483c-80ec-f4b11e74dc06 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 18 00:53:11.910687 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: warnings.warn(msg) Sep 18 00:53:11.910687 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: Sep 18 00:53:11.912692 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70845cc-fec7-483c-80ec-f4b11e74dc06 admin admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:53:11.937578 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 768/1501] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Sep 18 00:53:11 2022] PUT /identity/v3/projects/7e3045fdd52941c8be5ae1afba2915ff/users/99c45724ae1044d08472ec9274a9fef7/roles/59d7218a321b4c20bc1996494a48a2a1 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 00:53:11.950077 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0829d67-18c3-4f83-a99b-5fdca6569cae None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:53:11.950367 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0829d67-18c3-4f83-a99b-5fdca6569cae None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:53:11.950645 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0829d67-18c3-4f83-a99b-5fdca6569cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:53:12.009754 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-a0829d67-18c3-4f83-a99b-5fdca6569cae None None] MFA Rules not processed for user `99c45724ae1044d08472ec9274a9fef7`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:53:12.010881 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-a0829d67-18c3-4f83-a99b-5fdca6569cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:53:12.093292 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 734/1502] 10.222.0.15 () {58 vars in 958 bytes} [Sun Sep 18 00:53:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:53:12.106502 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e012c4-9695-4881-a6fc-6b091d0567fd None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:53:12.106791 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e012c4-9695-4881-a6fc-6b091d0567fd None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:53:12.107070 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e012c4-9695-4881-a6fc-6b091d0567fd None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:53:12.108455 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 769/1503] 10.222.0.15 () {54 vars in 964 bytes} [Sun Sep 18 00:53:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:53:12.113428 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f944de-5d36-4106-8f8a-2e0eac0ffb82 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:53:12.113718 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f944de-5d36-4106-8f8a-2e0eac0ffb82 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:53:12.113994 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f944de-5d36-4106-8f8a-2e0eac0ffb82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:53:12.146348 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:53:12.310993 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-b5f944de-5d36-4106-8f8a-2e0eac0ffb82 None None] MFA Rules not processed for user `6dbec16b81004ad3b4563ccc83d85c69`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:53:12.312164 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-b5f944de-5d36-4106-8f8a-2e0eac0ffb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:53:12.389744 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 735/1504] 10.222.0.15 () {58 vars in 1061 bytes} [Sun Sep 18 00:53:12 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:53:12.399433 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e012c4-9695-4881-a6fc-6b091d0567fd None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:53:12.401007 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-37e012c4-9695-4881-a6fc-6b091d0567fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:53:12.453810 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:53:12.512462 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e012c4-9695-4881-a6fc-6b091d0567fd None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:53:12.594030 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114229d1-3819-496d-9837-10d4d3d80a19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbec16b81004ad3b4563ccc83d85c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:53:12.594554 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114229d1-3819-496d-9837-10d4d3d80a19 service cinder] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:53:12.594835 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114229d1-3819-496d-9837-10d4d3d80a19 service cinder] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:53:12.595103 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114229d1-3819-496d-9837-10d4d3d80a19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:53:12.596751 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-114229d1-3819-496d-9837-10d4d3d80a19 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:53:12.698549 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114229d1-3819-496d-9837-10d4d3d80a19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:53:12.700090 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114229d1-3819-496d-9837-10d4d3d80a19 service cinder] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:53:12.703621 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:53:12.719009 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 770/1505] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:53:12 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 00:53:12.765345 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe2899-0a08-4f2e-b208-6eccca3b7766 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:53:12.765854 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe2899-0a08-4f2e-b208-6eccca3b7766 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:53:12.765953 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe2899-0a08-4f2e-b208-6eccca3b7766 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:53:12.767148 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 736/1506] 10.222.0.15 () {52 vars in 830 bytes} [Sun Sep 18 00:53:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:53:12.770721 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114229d1-3819-496d-9837-10d4d3d80a19 service cinder] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:53:12.771958 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-114229d1-3819-496d-9837-10d4d3d80a19 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:53:12.877785 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114229d1-3819-496d-9837-10d4d3d80a19 service cinder] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:53:12.973124 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84049cfd-0718-4035-882f-f3ed24d0a2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59ffbd91d29d4939bf7137c10c138592', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:53:12.973773 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84049cfd-0718-4035-882f-f3ed24d0a2da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:53:12.974057 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84049cfd-0718-4035-882f-f3ed24d0a2da admin admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:53:12.974329 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84049cfd-0718-4035-882f-f3ed24d0a2da admin admin] PATH_INFO: `/v3/users/99c45724ae1044d08472ec9274a9fef7` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:53:12.987457 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84049cfd-0718-4035-882f-f3ed24d0a2da admin admin] RBAC: Authorizing `identity:delete_user(user_id=99c45724ae1044d08472ec9274a9fef7)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:53:12.988525 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: WARNING py.warnings [None req-84049cfd-0718-4035-882f-f3ed24d0a2da admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 18 00:53:12.988525 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: warnings.warn(msg) Sep 18 00:53:12.988525 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: Sep 18 00:53:12.989756 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84049cfd-0718-4035-882f-f3ed24d0a2da admin admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:53:13.000562 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=100 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:53:13.069622 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.notifications [None req-84049cfd-0718-4035-882f-f3ed24d0a2da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99c45724ae1044d08472ec9274a9fef7'} {{(pid=81571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 00:53:13.082717 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.notifications [None req-84049cfd-0718-4035-882f-f3ed24d0a2da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99c45724ae1044d08472ec9274a9fef7'} {{(pid=81571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 00:53:13.083214 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.notifications [None req-84049cfd-0718-4035-882f-f3ed24d0a2da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99c45724ae1044d08472ec9274a9fef7'} {{(pid=81571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 00:53:13.098464 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.notifications [None req-84049cfd-0718-4035-882f-f3ed24d0a2da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99c45724ae1044d08472ec9274a9fef7'} {{(pid=81571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 00:53:13.122287 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.notifications [None req-84049cfd-0718-4035-882f-f3ed24d0a2da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99c45724ae1044d08472ec9274a9fef7'} {{(pid=81571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 00:53:13.128176 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 771/1507] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Sep 18 00:53:12 2022] DELETE /identity/v3/users/99c45724ae1044d08472ec9274a9fef7 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 00:53:13.132562 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd53cf-30c6-43d1-9adc-6957e12e8ca0 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:53:13.132844 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd53cf-30c6-43d1-9adc-6957e12e8ca0 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:53:13.133116 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd53cf-30c6-43d1-9adc-6957e12e8ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:53:13.191970 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-f6dd53cf-30c6-43d1-9adc-6957e12e8ca0 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:53:13.193249 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-f6dd53cf-30c6-43d1-9adc-6957e12e8ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:53:13.272638 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:53:13.285970 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 737/1508] 10.222.0.15 () {58 vars in 958 bytes} [Sun Sep 18 00:53:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:53:13.297350 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84049cfd-0718-4035-882f-f3ed24d0a2da admin admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:53:13.298588 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-84049cfd-0718-4035-882f-f3ed24d0a2da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:53:13.411630 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84049cfd-0718-4035-882f-f3ed24d0a2da admin admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:53:13.482223 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:53:13.504544 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b51c1-c776-405b-b271-4f10d4dbafdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e46cfbc3b604788a833a81befaaab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:53:13.505186 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b51c1-c776-405b-b271-4f10d4dbafdd service neutron] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:53:13.505526 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b51c1-c776-405b-b271-4f10d4dbafdd service neutron] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:53:13.505801 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b51c1-c776-405b-b271-4f10d4dbafdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:53:13.507326 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-862b51c1-c776-405b-b271-4f10d4dbafdd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:53:13.619043 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862b51c1-c776-405b-b271-4f10d4dbafdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:53:13.620527 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862b51c1-c776-405b-b271-4f10d4dbafdd service neutron] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:53:13.639200 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 772/1509] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:53:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 00:53:13.993229 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dd53cf-30c6-43d1-9adc-6957e12e8ca0 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:53:13.994496 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-f6dd53cf-30c6-43d1-9adc-6957e12e8ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:53:14.007267 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dd53cf-30c6-43d1-9adc-6957e12e8ca0 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:53:14.117071 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cd27bd-ff94-4a2c-b603-40381943796c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59ffbd91d29d4939bf7137c10c138592', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:53:14.117768 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd27bd-ff94-4a2c-b603-40381943796c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:53:14.118055 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd27bd-ff94-4a2c-b603-40381943796c admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:53:14.118329 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd27bd-ff94-4a2c-b603-40381943796c admin admin] PATH_INFO: `/v3/projects/7e3045fdd52941c8be5ae1afba2915ff` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:53:14.128994 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cd27bd-ff94-4a2c-b603-40381943796c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e3045fdd52941c8be5ae1afba2915ff)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:53:14.130019 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: WARNING py.warnings [None req-b4cd27bd-ff94-4a2c-b603-40381943796c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 18 00:53:14.130019 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: warnings.warn(msg) Sep 18 00:53:14.130019 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: Sep 18 00:53:14.131222 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cd27bd-ff94-4a2c-b603-40381943796c admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:53:14.190499 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-b4cd27bd-ff94-4a2c-b603-40381943796c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e3045fdd52941c8be5ae1afba2915ff', 'request_id': 'req-b4cd27bd-ff94-4a2c-b603-40381943796c'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 00:53:14.202979 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-b4cd27bd-ff94-4a2c-b603-40381943796c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e3045fdd52941c8be5ae1afba2915ff', 'request_id': 'req-b4cd27bd-ff94-4a2c-b603-40381943796c'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 00:53:14.209889 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-b4cd27bd-ff94-4a2c-b603-40381943796c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e3045fdd52941c8be5ae1afba2915ff', 'request_id': 'req-b4cd27bd-ff94-4a2c-b603-40381943796c'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 00:53:14.240700 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-b4cd27bd-ff94-4a2c-b603-40381943796c admin admin] The token cache is being invalidate because project 7e3045fdd52941c8be5ae1afba2915ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 00:53:14.240918 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-b4cd27bd-ff94-4a2c-b603-40381943796c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 00:53:14.241434 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-b4cd27bd-ff94-4a2c-b603-40381943796c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 00:53:14.242979 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 738/1510] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Sep 18 00:53:13 2022] DELETE /identity/v3/projects/7e3045fdd52941c8be5ae1afba2915ff => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 00:53:23.636672 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=62 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:53:24.238595 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:54:33.194458 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c403df-93cc-4183-a31f-e2ac31c83039 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:54:33.195071 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c403df-93cc-4183-a31f-e2ac31c83039 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:54:33.195071 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c403df-93cc-4183-a31f-e2ac31c83039 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:54:33.196486 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 773/1511] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 18 00:54:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:54:33.202506 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d7627-f2b3-4811-ba61-b1fad227e066 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:54:33.203071 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d7627-f2b3-4811-ba61-b1fad227e066 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:54:33.203071 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d7627-f2b3-4811-ba61-b1fad227e066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:54:33.288098 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-cd3d7627-f2b3-4811-ba61-b1fad227e066 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:54:33.289297 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-cd3d7627-f2b3-4811-ba61-b1fad227e066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:54:33.403474 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 739/1512] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 18 00:54:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:54:33.557691 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c403df-93cc-4183-a31f-e2ac31c83039 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:54:33.560503 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-d4c403df-93cc-4183-a31f-e2ac31c83039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:54:33.687789 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c403df-93cc-4183-a31f-e2ac31c83039 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:54:33.693599 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf6e08c-1b34-40fe-8dc8-fba233cf2924 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264c183fff8a49478eea4aceea73273e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:54:33.694215 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6e08c-1b34-40fe-8dc8-fba233cf2924 service nova] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:54:33.694499 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6e08c-1b34-40fe-8dc8-fba233cf2924 service nova] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:54:33.694778 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6e08c-1b34-40fe-8dc8-fba233cf2924 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:54:33.704029 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf6e08c-1b34-40fe-8dc8-fba233cf2924 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:54:33.705622 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf6e08c-1b34-40fe-8dc8-fba233cf2924 service nova] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:54:33.716589 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 774/1513] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:54:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 00:54:34.811389 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58630a5f-993e-439a-91e1-1166264fe91b None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:54:34.812000 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58630a5f-993e-439a-91e1-1166264fe91b None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:54:34.812000 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58630a5f-993e-439a-91e1-1166264fe91b None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:54:34.813329 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 740/1514] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 18 00:54:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:54:34.819694 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8c49a-b186-44da-b503-2533216ddc4d None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:54:34.820195 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8c49a-b186-44da-b503-2533216ddc4d None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:54:34.820320 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8c49a-b186-44da-b503-2533216ddc4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:54:34.839739 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-f0b8c49a-b186-44da-b503-2533216ddc4d None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:54:34.840974 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-f0b8c49a-b186-44da-b503-2533216ddc4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:54:34.848976 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 775/1515] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 18 00:54:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:54:35.000679 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58630a5f-993e-439a-91e1-1166264fe91b None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:54:35.014875 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58630a5f-993e-439a-91e1-1166264fe91b None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:54:35.020348 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe4f8f3-d3e9-4667-97ee-bed0c6b48f52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264c183fff8a49478eea4aceea73273e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:54:35.020950 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4f8f3-d3e9-4667-97ee-bed0c6b48f52 service nova] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:54:35.021238 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4f8f3-d3e9-4667-97ee-bed0c6b48f52 service nova] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:54:35.021513 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4f8f3-d3e9-4667-97ee-bed0c6b48f52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:54:35.029600 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe4f8f3-d3e9-4667-97ee-bed0c6b48f52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:54:35.031185 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe4f8f3-d3e9-4667-97ee-bed0c6b48f52 service nova] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:54:35.040566 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 741/1516] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:54:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 00:54:36.708600 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad987aa6-c038-42db-a983-64cadb3171b0 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:54:36.709169 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad987aa6-c038-42db-a983-64cadb3171b0 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:54:36.709169 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad987aa6-c038-42db-a983-64cadb3171b0 None None] PATH_INFO: `/v3` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:54:36.710434 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 776/1517] 10.222.0.50 () {54 vars in 925 bytes} [Sun Sep 18 00:54:36 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:54:36.716411 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250462a-70a1-4a28-baa7-f4ce54c4cb6c None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:54:36.716831 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250462a-70a1-4a28-baa7-f4ce54c4cb6c None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:54:36.716986 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250462a-70a1-4a28-baa7-f4ce54c4cb6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:54:36.776297 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-3250462a-70a1-4a28-baa7-f4ce54c4cb6c None None] MFA Rules not processed for user `7239e730ee034affb6bdf27e106c49cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:54:36.777415 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-3250462a-70a1-4a28-baa7-f4ce54c4cb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:54:36.794069 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:54:36.848712 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 742/1518] 10.222.0.50 () {58 vars in 1015 bytes} [Sun Sep 18 00:54:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 00:54:44.834795 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=56 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:54:45.364814 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd153d15-a5fe-4b8b-afc6-8c1fbee29122 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:54:45.365121 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd153d15-a5fe-4b8b-afc6-8c1fbee29122 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:54:45.365406 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd153d15-a5fe-4b8b-afc6-8c1fbee29122 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:54:45.366782 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 777/1519] 10.222.0.15 () {54 vars in 961 bytes} [Sun Sep 18 00:54:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 18 00:54:45.372190 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9857e-dec6-48c2-81f7-4d7243ebdf22 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:54:45.372702 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9857e-dec6-48c2-81f7-4d7243ebdf22 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:54:45.372812 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9857e-dec6-48c2-81f7-4d7243ebdf22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:54:45.394010 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-77f9857e-dec6-48c2-81f7-4d7243ebdf22 None None] MFA Rules not processed for user `7239e730ee034affb6bdf27e106c49cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:54:45.395222 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-77f9857e-dec6-48c2-81f7-4d7243ebdf22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:54:45.407404 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 743/1520] 10.222.0.15 () {58 vars in 1058 bytes} [Sun Sep 18 00:54:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:54:45.412668 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd153d15-a5fe-4b8b-afc6-8c1fbee29122 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:54:45.426519 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd153d15-a5fe-4b8b-afc6-8c1fbee29122 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:54:45.431554 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660d8517-2c25-43e8-aae8-2d12fc84d05f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7239e730ee034affb6bdf27e106c49cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:54:45.432212 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d8517-2c25-43e8-aae8-2d12fc84d05f service placement] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:54:45.432491 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d8517-2c25-43e8-aae8-2d12fc84d05f service placement] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:54:45.432794 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d8517-2c25-43e8-aae8-2d12fc84d05f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:54:45.444175 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660d8517-2c25-43e8-aae8-2d12fc84d05f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:54:45.446167 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660d8517-2c25-43e8-aae8-2d12fc84d05f service placement] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:54:45.463296 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 778/1521] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:54:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 00:54:46.552361 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90e71a-3b03-4ffa-b8d1-7e379554cd10 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:54:46.552936 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90e71a-3b03-4ffa-b8d1-7e379554cd10 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:54:46.552936 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90e71a-3b03-4ffa-b8d1-7e379554cd10 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:54:46.554420 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 744/1522] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 18 00:54:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:54:46.560960 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d0758-1cde-43c5-b05c-381e71e1b81d None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:54:46.561461 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d0758-1cde-43c5-b05c-381e71e1b81d None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:54:46.561573 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d0758-1cde-43c5-b05c-381e71e1b81d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:54:46.581300 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-353d0758-1cde-43c5-b05c-381e71e1b81d None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:54:46.582506 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-353d0758-1cde-43c5-b05c-381e71e1b81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:54:46.591180 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 779/1523] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 18 00:54:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:54:46.745512 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee90e71a-3b03-4ffa-b8d1-7e379554cd10 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:54:46.759991 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee90e71a-3b03-4ffa-b8d1-7e379554cd10 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:54:46.769150 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7def0e-4b70-4de9-b330-da80ec12026e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264c183fff8a49478eea4aceea73273e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:54:46.769150 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7def0e-4b70-4de9-b330-da80ec12026e service nova] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:54:46.769150 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7def0e-4b70-4de9-b330-da80ec12026e service nova] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:54:46.769150 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7def0e-4b70-4de9-b330-da80ec12026e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:54:46.775324 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7def0e-4b70-4de9-b330-da80ec12026e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:54:46.776975 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7def0e-4b70-4de9-b330-da80ec12026e service nova] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:54:46.790611 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 745/1524] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:54:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 00:54:47.884381 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89de53-c4dd-4bf0-a327-34a0fc9041c0 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:54:47.884916 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89de53-c4dd-4bf0-a327-34a0fc9041c0 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:54:47.884916 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89de53-c4dd-4bf0-a327-34a0fc9041c0 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:54:47.886320 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 780/1525] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 18 00:54:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:54:47.893652 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ff604-1ee8-4aae-8c0a-0cd931d1ffdb None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:54:47.894132 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ff604-1ee8-4aae-8c0a-0cd931d1ffdb None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:54:47.894243 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ff604-1ee8-4aae-8c0a-0cd931d1ffdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:54:47.914343 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-368ff604-1ee8-4aae-8c0a-0cd931d1ffdb None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:54:47.915553 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-368ff604-1ee8-4aae-8c0a-0cd931d1ffdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:54:47.923680 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 746/1526] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 18 00:54:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:54:48.075510 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c89de53-c4dd-4bf0-a327-34a0fc9041c0 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:54:48.090560 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c89de53-c4dd-4bf0-a327-34a0fc9041c0 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:54:48.101150 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa51cff-05e2-4ab2-8ebe-f3daa7a78362 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264c183fff8a49478eea4aceea73273e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:54:48.101781 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa51cff-05e2-4ab2-8ebe-f3daa7a78362 service nova] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:54:48.102068 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa51cff-05e2-4ab2-8ebe-f3daa7a78362 service nova] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:54:48.102346 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa51cff-05e2-4ab2-8ebe-f3daa7a78362 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:54:48.115344 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa51cff-05e2-4ab2-8ebe-f3daa7a78362 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:54:48.116976 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa51cff-05e2-4ab2-8ebe-f3daa7a78362 service nova] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:54:48.127519 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 781/1527] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:54:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 00:54:52.291602 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b864f-c8f5-45f5-a5f5-8ebc461cbf95 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:54:52.292474 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b864f-c8f5-45f5-a5f5-8ebc461cbf95 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:54:52.292474 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b864f-c8f5-45f5-a5f5-8ebc461cbf95 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:54:52.293780 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 747/1528] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 18 00:54:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:54:52.299720 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36631968-bdc5-4460-945a-7617ed0fa5fb None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:54:52.300169 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36631968-bdc5-4460-945a-7617ed0fa5fb None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:54:52.300340 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36631968-bdc5-4460-945a-7617ed0fa5fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:54:52.320146 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-36631968-bdc5-4460-945a-7617ed0fa5fb None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:54:52.321348 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-36631968-bdc5-4460-945a-7617ed0fa5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:54:52.329220 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 782/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 18 00:54:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 00:54:52.613867 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b864f-c8f5-45f5-a5f5-8ebc461cbf95 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:54:52.615581 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-d55b864f-c8f5-45f5-a5f5-8ebc461cbf95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:54:52.693821 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b864f-c8f5-45f5-a5f5-8ebc461cbf95 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:54:52.697328 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10075be-c9b4-47ab-a969-a9165c6f1c40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e46cfbc3b604788a833a81befaaab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:54:52.697927 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10075be-c9b4-47ab-a969-a9165c6f1c40 service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:54:52.698203 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10075be-c9b4-47ab-a969-a9165c6f1c40 service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:54:52.698471 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10075be-c9b4-47ab-a969-a9165c6f1c40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:54:52.707173 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10075be-c9b4-47ab-a969-a9165c6f1c40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:54:52.708615 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10075be-c9b4-47ab-a969-a9165c6f1c40 service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:54:52.718275 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 748/1530] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:54:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 00:54:54.859243 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf0363-e192-4143-82fa-773980c7d002 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:54:54.859863 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf0363-e192-4143-82fa-773980c7d002 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:54:54.859863 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf0363-e192-4143-82fa-773980c7d002 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:54:54.861158 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 783/1531] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 18 00:54:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 18 00:54:54.866468 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfb2c4-0264-4408-99b3-03f978a0785d None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:54:54.866958 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfb2c4-0264-4408-99b3-03f978a0785d None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:54:54.867065 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfb2c4-0264-4408-99b3-03f978a0785d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:54:54.886461 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-44cfb2c4-0264-4408-99b3-03f978a0785d None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:54:54.887650 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-44cfb2c4-0264-4408-99b3-03f978a0785d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:54:54.895604 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 749/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 18 00:54:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:54:55.181989 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf0363-e192-4143-82fa-773980c7d002 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:54:55.192839 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf0363-e192-4143-82fa-773980c7d002 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:54:55.196355 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563daa2f-840a-4ed7-b128-7095ad24346a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e46cfbc3b604788a833a81befaaab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:54:55.196955 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563daa2f-840a-4ed7-b128-7095ad24346a service neutron] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:54:55.197237 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563daa2f-840a-4ed7-b128-7095ad24346a service neutron] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:54:55.197510 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563daa2f-840a-4ed7-b128-7095ad24346a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:54:55.206794 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563daa2f-840a-4ed7-b128-7095ad24346a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:54:55.208261 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563daa2f-840a-4ed7-b128-7095ad24346a service neutron] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:54:55.218102 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 784/1533] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:54:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 00:54:58.952937 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec758e-bd15-4c9e-bda0-3644f77bb56b None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:54:58.953542 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec758e-bd15-4c9e-bda0-3644f77bb56b None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:54:58.953542 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec758e-bd15-4c9e-bda0-3644f77bb56b None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:54:58.954987 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 750/1534] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 18 00:54:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:54:58.960454 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eca63d-94f6-445f-82f8-349a34e6fd2a None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:54:58.960896 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eca63d-94f6-445f-82f8-349a34e6fd2a None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:54:58.961008 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eca63d-94f6-445f-82f8-349a34e6fd2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:54:58.980996 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-07eca63d-94f6-445f-82f8-349a34e6fd2a None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:54:58.982249 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-07eca63d-94f6-445f-82f8-349a34e6fd2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:54:58.989996 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 785/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 18 00:54:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:54:59.293544 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cec758e-bd15-4c9e-bda0-3644f77bb56b None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:54:59.295273 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-4cec758e-bd15-4c9e-bda0-3644f77bb56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:54:59.360859 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:54:59.375036 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cec758e-bd15-4c9e-bda0-3644f77bb56b None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:54:59.378652 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9ad563-6658-4515-a6b5-9c10fd9fe917 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbec16b81004ad3b4563ccc83d85c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:54:59.379260 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ad563-6658-4515-a6b5-9c10fd9fe917 service cinder] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:54:59.379544 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ad563-6658-4515-a6b5-9c10fd9fe917 service cinder] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:54:59.379820 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ad563-6658-4515-a6b5-9c10fd9fe917 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:54:59.389736 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9ad563-6658-4515-a6b5-9c10fd9fe917 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:54:59.391179 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9ad563-6658-4515-a6b5-9c10fd9fe917 service cinder] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:54:59.401137 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 751/1536] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:54:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 00:55:01.599561 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b2bade-79c5-4196-b084-0477e31ccea1 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:55:01.600155 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b2bade-79c5-4196-b084-0477e31ccea1 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:55:01.600155 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b2bade-79c5-4196-b084-0477e31ccea1 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:55:01.601541 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 786/1537] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 18 00:55:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:55:01.607633 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1691a-94f9-49d3-8a7e-ec4c4192c6fa None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:55:01.608096 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1691a-94f9-49d3-8a7e-ec4c4192c6fa None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:55:01.608228 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1691a-94f9-49d3-8a7e-ec4c4192c6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:55:01.627550 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-eaf1691a-94f9-49d3-8a7e-ec4c4192c6fa None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:55:01.628800 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-eaf1691a-94f9-49d3-8a7e-ec4c4192c6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:55:01.636668 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 752/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 18 00:55:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:55:01.951789 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b2bade-79c5-4196-b084-0477e31ccea1 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:55:01.953491 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-51b2bade-79c5-4196-b084-0477e31ccea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:55:01.966912 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b2bade-79c5-4196-b084-0477e31ccea1 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:55:01.970533 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5763c1c2-fed6-4a39-92e1-4f0f08cc340f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbec16b81004ad3b4563ccc83d85c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:55:01.971133 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763c1c2-fed6-4a39-92e1-4f0f08cc340f service cinder] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:55:01.971418 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763c1c2-fed6-4a39-92e1-4f0f08cc340f service cinder] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:55:01.971694 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763c1c2-fed6-4a39-92e1-4f0f08cc340f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:55:01.980732 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5763c1c2-fed6-4a39-92e1-4f0f08cc340f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:55:01.982155 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5763c1c2-fed6-4a39-92e1-4f0f08cc340f service cinder] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:55:01.991503 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 787/1539] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:55:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 00:55:11.622788 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=11 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:55:11.987326 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=33 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:56:21.420795 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26327f-0598-4471-9b81-02f8a4703cbc None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:56:21.421395 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26327f-0598-4471-9b81-02f8a4703cbc None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:56:21.421395 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26327f-0598-4471-9b81-02f8a4703cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:56:21.430744 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e737c8d-73d5-49e3-8214-dd9d91fc4e06 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:56:21.431267 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e737c8d-73d5-49e3-8214-dd9d91fc4e06 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:56:21.431267 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e737c8d-73d5-49e3-8214-dd9d91fc4e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:56:21.442415 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-ce26327f-0598-4471-9b81-02f8a4703cbc None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:56:21.443635 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-ce26327f-0598-4471-9b81-02f8a4703cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:56:21.451148 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-0e737c8d-73d5-49e3-8214-dd9d91fc4e06 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:56:21.451745 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 753/1540] 10.222.0.15 () {58 vars in 958 bytes} [Sun Sep 18 00:56:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:56:21.452362 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-0e737c8d-73d5-49e3-8214-dd9d91fc4e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:56:21.459821 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d171c-94bd-402b-91aa-754e878cb4a1 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:56:21.460344 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d171c-94bd-402b-91aa-754e878cb4a1 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:56:21.460481 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 788/1541] 10.222.0.15 () {58 vars in 958 bytes} [Sun Sep 18 00:56:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 00:56:21.460582 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d171c-94bd-402b-91aa-754e878cb4a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:56:21.468223 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a242fd8b-9f98-4b76-b070-ffec484a85eb None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:56:21.468512 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a242fd8b-9f98-4b76-b070-ffec484a85eb None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:56:21.468797 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a242fd8b-9f98-4b76-b070-ffec484a85eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:56:21.483286 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-976d171c-94bd-402b-91aa-754e878cb4a1 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:56:21.483286 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-976d171c-94bd-402b-91aa-754e878cb4a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:56:21.491111 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-a242fd8b-9f98-4b76-b070-ffec484a85eb None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:56:21.491602 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 754/1542] 10.222.0.15 () {58 vars in 958 bytes} [Sun Sep 18 00:56:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 00:56:21.492118 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-a242fd8b-9f98-4b76-b070-ffec484a85eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:56:21.496521 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d171c-94bd-402b-91aa-754e878cb4a1 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:56:21.500982 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 789/1543] 10.222.0.15 () {58 vars in 958 bytes} [Sun Sep 18 00:56:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 00:56:21.505340 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a242fd8b-9f98-4b76-b070-ffec484a85eb None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:56:21.505762 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d171c-94bd-402b-91aa-754e878cb4a1 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:56:21.511052 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f258b0fa-4b69-4427-af59-1fe7a3dcfaed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59ffbd91d29d4939bf7137c10c138592', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:56:21.511668 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258b0fa-4b69-4427-af59-1fe7a3dcfaed admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:56:21.511982 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258b0fa-4b69-4427-af59-1fe7a3dcfaed admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:56:21.512261 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258b0fa-4b69-4427-af59-1fe7a3dcfaed admin admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:56:21.512904 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f258b0fa-4b69-4427-af59-1fe7a3dcfaed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:56:21.513209 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f258b0fa-4b69-4427-af59-1fe7a3dcfaed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:56:21.514934 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a242fd8b-9f98-4b76-b070-ffec484a85eb None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:56:21.515058 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f258b0fa-4b69-4427-af59-1fe7a3dcfaed admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:56:21.519940 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5067f92f-e0dc-45be-9211-691d4f34980d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59ffbd91d29d4939bf7137c10c138592', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:56:21.520553 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067f92f-e0dc-45be-9211-691d4f34980d admin admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:56:21.520834 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067f92f-e0dc-45be-9211-691d4f34980d admin admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:56:21.521111 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067f92f-e0dc-45be-9211-691d4f34980d admin admin] PATH_INFO: `/v3/domains` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:56:21.521762 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5067f92f-e0dc-45be-9211-691d4f34980d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81571) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 18 00:56:21.522066 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5067f92f-e0dc-45be-9211-691d4f34980d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:56:21.523082 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: WARNING py.warnings [None req-5067f92f-e0dc-45be-9211-691d4f34980d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 18 00:56:21.523082 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: warnings.warn(msg) Sep 18 00:56:21.523082 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: Sep 18 00:56:21.523995 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5067f92f-e0dc-45be-9211-691d4f34980d admin admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:56:21.527947 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 755/1544] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Sep 18 00:56:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 18 00:56:21.536174 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f258b0fa-4b69-4427-af59-1fe7a3dcfaed admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:56:21.536615 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 790/1545] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Sep 18 00:56:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 18 00:56:21.544764 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5067f92f-e0dc-45be-9211-691d4f34980d admin admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:56:21.549830 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f258b0fa-4b69-4427-af59-1fe7a3dcfaed admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:56:21.554466 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5067f92f-e0dc-45be-9211-691d4f34980d admin admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:56:21.554916 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f463823-0b82-4a7c-999a-70cd5771b2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59ffbd91d29d4939bf7137c10c138592', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:56:21.555518 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f463823-0b82-4a7c-999a-70cd5771b2a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:56:21.555798 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f463823-0b82-4a7c-999a-70cd5771b2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:56:21.556104 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f463823-0b82-4a7c-999a-70cd5771b2a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:56:21.556732 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f463823-0b82-4a7c-999a-70cd5771b2a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:56:21.557750 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: WARNING py.warnings [None req-1f463823-0b82-4a7c-999a-70cd5771b2a0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 18 00:56:21.557750 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: warnings.warn(msg) Sep 18 00:56:21.557750 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: Sep 18 00:56:21.558939 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f463823-0b82-4a7c-999a-70cd5771b2a0 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:56:21.559858 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5996c26b-24ba-42b0-a840-c00caf8e0998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59ffbd91d29d4939bf7137c10c138592', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:56:21.560480 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5996c26b-24ba-42b0-a840-c00caf8e0998 admin admin] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:56:21.560758 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5996c26b-24ba-42b0-a840-c00caf8e0998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:56:21.561060 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5996c26b-24ba-42b0-a840-c00caf8e0998 admin admin] PATH_INFO: `/v3/projects` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:56:21.561681 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5996c26b-24ba-42b0-a840-c00caf8e0998 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:56:21.563783 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5996c26b-24ba-42b0-a840-c00caf8e0998 admin admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:56:21.598829 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 756/1546] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Sep 18 00:56:21 2022] POST /identity/v3/projects => generated 379 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 00:56:21.602907 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f463823-0b82-4a7c-999a-70cd5771b2a0 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:56:21.605404 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 791/1547] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Sep 18 00:56:21 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 00:56:21.609240 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5996c26b-24ba-42b0-a840-c00caf8e0998 admin admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:56:21.670081 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f463823-0b82-4a7c-999a-70cd5771b2a0 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:56:21.672717 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5996c26b-24ba-42b0-a840-c00caf8e0998 admin admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:56:21.674826 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d083727-03fc-4cd3-b2bd-c68955f2bcb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59ffbd91d29d4939bf7137c10c138592', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:56:21.675474 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d083727-03fc-4cd3-b2bd-c68955f2bcb2 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:56:21.675767 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d083727-03fc-4cd3-b2bd-c68955f2bcb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:56:21.676076 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d083727-03fc-4cd3-b2bd-c68955f2bcb2 admin admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:56:21.676718 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d083727-03fc-4cd3-b2bd-c68955f2bcb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:56:21.678703 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d083727-03fc-4cd3-b2bd-c68955f2bcb2 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:56:21.685254 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce868f-c9e8-4c17-bdf0-c9eb722f8864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59ffbd91d29d4939bf7137c10c138592', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:56:21.685938 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce868f-c9e8-4c17-bdf0-c9eb722f8864 admin admin] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:56:21.686222 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce868f-c9e8-4c17-bdf0-c9eb722f8864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:56:21.686511 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce868f-c9e8-4c17-bdf0-c9eb722f8864 admin admin] PATH_INFO: `/v3/users` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:56:21.687134 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ce868f-c9e8-4c17-bdf0-c9eb722f8864 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:56:21.688223 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: WARNING py.warnings [None req-76ce868f-c9e8-4c17-bdf0-c9eb722f8864 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 18 00:56:21.688223 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: warnings.warn(msg) Sep 18 00:56:21.688223 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: Sep 18 00:56:21.689476 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ce868f-c9e8-4c17-bdf0-c9eb722f8864 admin admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:56:21.703797 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 757/1548] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Sep 18 00:56:21 2022] POST /identity/v3/users => generated 290 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 00:56:21.707857 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d083727-03fc-4cd3-b2bd-c68955f2bcb2 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:56:21.716399 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 792/1549] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Sep 18 00:56:21 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 00:56:21.717946 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d083727-03fc-4cd3-b2bd-c68955f2bcb2 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:56:21.720864 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce868f-c9e8-4c17-bdf0-c9eb722f8864 admin admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:56:21.723103 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c4319-b602-4130-a81d-06bf3c294362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59ffbd91d29d4939bf7137c10c138592', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:56:21.723699 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c4319-b602-4130-a81d-06bf3c294362 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:56:21.724008 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c4319-b602-4130-a81d-06bf3c294362 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:56:21.724290 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c4319-b602-4130-a81d-06bf3c294362 admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:56:21.724932 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c4319-b602-4130-a81d-06bf3c294362 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:56:21.726528 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c4319-b602-4130-a81d-06bf3c294362 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:56:21.730855 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce868f-c9e8-4c17-bdf0-c9eb722f8864 admin admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:56:21.735947 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597eba11-85a8-4993-a384-8109f29b90e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59ffbd91d29d4939bf7137c10c138592', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:56:21.736557 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597eba11-85a8-4993-a384-8109f29b90e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:56:21.736815 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597eba11-85a8-4993-a384-8109f29b90e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:56:21.737085 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 758/1550] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Sep 18 00:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 18 00:56:21.737210 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597eba11-85a8-4993-a384-8109f29b90e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:56:21.737736 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597eba11-85a8-4993-a384-8109f29b90e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:56:21.739290 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597eba11-85a8-4993-a384-8109f29b90e8 admin admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:56:21.740987 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c4319-b602-4130-a81d-06bf3c294362 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:56:21.750276 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 793/1551] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Sep 18 00:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 18 00:56:21.751195 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c4319-b602-4130-a81d-06bf3c294362 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:56:21.754257 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597eba11-85a8-4993-a384-8109f29b90e8 admin admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:56:21.755972 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b1e9e-4490-4c45-bfba-f706f9c44259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59ffbd91d29d4939bf7137c10c138592', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:56:21.756577 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b1e9e-4490-4c45-bfba-f706f9c44259 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:56:21.756860 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b1e9e-4490-4c45-bfba-f706f9c44259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:56:21.757136 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b1e9e-4490-4c45-bfba-f706f9c44259 admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:56:21.757770 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637b1e9e-4490-4c45-bfba-f706f9c44259 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:56:21.759383 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637b1e9e-4490-4c45-bfba-f706f9c44259 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:56:21.764637 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597eba11-85a8-4993-a384-8109f29b90e8 admin admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:56:21.769647 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82909ef7-280a-4a7c-9d34-34bf90ad960e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59ffbd91d29d4939bf7137c10c138592', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:56:21.770256 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82909ef7-280a-4a7c-9d34-34bf90ad960e admin admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:56:21.770540 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82909ef7-280a-4a7c-9d34-34bf90ad960e admin admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:56:21.770816 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82909ef7-280a-4a7c-9d34-34bf90ad960e admin admin] PATH_INFO: `/v3/roles` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:56:21.771010 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 759/1552] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Sep 18 00:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 18 00:56:21.771459 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82909ef7-280a-4a7c-9d34-34bf90ad960e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:56:21.773088 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82909ef7-280a-4a7c-9d34-34bf90ad960e admin admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:56:21.775157 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b1e9e-4490-4c45-bfba-f706f9c44259 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:56:21.784348 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 794/1553] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Sep 18 00:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 00:56:21.784878 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b1e9e-4490-4c45-bfba-f706f9c44259 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:56:21.788574 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82909ef7-280a-4a7c-9d34-34bf90ad960e admin admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:56:21.789614 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e392a-9713-4632-adb5-177292edf490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59ffbd91d29d4939bf7137c10c138592', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:56:21.790271 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e392a-9713-4632-adb5-177292edf490 admin admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:56:21.790554 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e392a-9713-4632-adb5-177292edf490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:56:21.790860 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e392a-9713-4632-adb5-177292edf490 admin admin] PATH_INFO: `/v3/projects/e2d6b887d368404b837b652b698e5f8b/users/eed2ae18eb944593b93d80372d671e88/roles/59d7218a321b4c20bc1996494a48a2a1` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:56:21.798430 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82909ef7-280a-4a7c-9d34-34bf90ad960e admin admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:56:21.803150 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f74130-fdaa-4088-9660-a0a7429f8d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59ffbd91d29d4939bf7137c10c138592', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:56:21.803817 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f74130-fdaa-4088-9660-a0a7429f8d52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:56:21.804192 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f74130-fdaa-4088-9660-a0a7429f8d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:56:21.804476 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f74130-fdaa-4088-9660-a0a7429f8d52 admin admin] PATH_INFO: `/v3/projects/f70e8748a48b4f50a9c3201beabaaa11/users/77466ec3b67a48c0b4435f6390561881/roles/59d7218a321b4c20bc1996494a48a2a1` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:56:21.808100 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0e392a-9713-4632-adb5-177292edf490 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2d6b887d368404b837b652b698e5f8b, user_id=eed2ae18eb944593b93d80372d671e88, role_id=59d7218a321b4c20bc1996494a48a2a1)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:56:21.809162 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: WARNING py.warnings [None req-ef0e392a-9713-4632-adb5-177292edf490 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 18 00:56:21.809162 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: warnings.warn(msg) Sep 18 00:56:21.809162 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: Sep 18 00:56:21.811171 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0e392a-9713-4632-adb5-177292edf490 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:56:21.823547 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f74130-fdaa-4088-9660-a0a7429f8d52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f70e8748a48b4f50a9c3201beabaaa11, user_id=77466ec3b67a48c0b4435f6390561881, role_id=59d7218a321b4c20bc1996494a48a2a1)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:56:21.826198 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 760/1554] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Sep 18 00:56:21 2022] PUT /identity/v3/projects/e2d6b887d368404b837b652b698e5f8b/users/eed2ae18eb944593b93d80372d671e88/roles/59d7218a321b4c20bc1996494a48a2a1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 00:56:21.826348 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f74130-fdaa-4088-9660-a0a7429f8d52 admin admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:56:21.831326 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7cd507-1f54-4254-a47f-d165d48eff92 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:56:21.831621 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7cd507-1f54-4254-a47f-d165d48eff92 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:56:21.831917 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7cd507-1f54-4254-a47f-d165d48eff92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:56:21.842229 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 795/1555] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Sep 18 00:56:21 2022] PUT /identity/v3/projects/f70e8748a48b4f50a9c3201beabaaa11/users/77466ec3b67a48c0b4435f6390561881/roles/59d7218a321b4c20bc1996494a48a2a1 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 18 00:56:21.847526 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c517e2a-2e1c-4c7e-b4f8-6d14d784b0cc None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:56:21.847822 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c517e2a-2e1c-4c7e-b4f8-6d14d784b0cc None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:56:21.848139 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c517e2a-2e1c-4c7e-b4f8-6d14d784b0cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:56:21.851309 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-ae7cd507-1f54-4254-a47f-d165d48eff92 None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:56:21.852558 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-ae7cd507-1f54-4254-a47f-d165d48eff92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:56:21.867716 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-1c517e2a-2e1c-4c7e-b4f8-6d14d784b0cc None None] MFA Rules not processed for user `0f8bf0607941426a8b8271be8b554394`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:56:21.869486 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-1c517e2a-2e1c-4c7e-b4f8-6d14d784b0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:56:21.895106 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:56:21.913048 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:56:21.913724 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 761/1556] 10.222.0.15 () {58 vars in 958 bytes} [Sun Sep 18 00:56:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 00:56:21.924387 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7cd507-1f54-4254-a47f-d165d48eff92 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:56:21.934510 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 796/1557] 10.222.0.15 () {58 vars in 958 bytes} [Sun Sep 18 00:56:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 00:56:21.944530 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c517e2a-2e1c-4c7e-b4f8-6d14d784b0cc None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:56:21.991800 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7cd507-1f54-4254-a47f-d165d48eff92 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:56:21.996311 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd9414e-462e-4619-ba4f-ad06dcbb8212 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e46cfbc3b604788a833a81befaaab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:56:21.996923 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9414e-462e-4619-ba4f-ad06dcbb8212 service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:56:21.997203 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9414e-462e-4619-ba4f-ad06dcbb8212 service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:56:21.997486 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9414e-462e-4619-ba4f-ad06dcbb8212 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:56:22.007624 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd9414e-462e-4619-ba4f-ad06dcbb8212 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:56:22.009121 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd9414e-462e-4619-ba4f-ad06dcbb8212 service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:56:22.020964 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 762/1558] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:56:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 18 00:56:22.022693 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c517e2a-2e1c-4c7e-b4f8-6d14d784b0cc None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:56:22.027851 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bdca35-db21-43b1-9e79-356c8c54d388 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e46cfbc3b604788a833a81befaaab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:56:22.028650 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bdca35-db21-43b1-9e79-356c8c54d388 service neutron] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:56:22.028961 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bdca35-db21-43b1-9e79-356c8c54d388 service neutron] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:56:22.029265 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bdca35-db21-43b1-9e79-356c8c54d388 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:56:22.040457 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bdca35-db21-43b1-9e79-356c8c54d388 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:56:22.042863 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bdca35-db21-43b1-9e79-356c8c54d388 service neutron] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:56:22.054002 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 797/1559] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:56:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 18 00:56:26.834811 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2140f65-c325-4644-bcd8-23f93be9f374 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:56:26.835435 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2140f65-c325-4644-bcd8-23f93be9f374 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:56:26.835435 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2140f65-c325-4644-bcd8-23f93be9f374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:56:26.888612 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-c2140f65-c325-4644-bcd8-23f93be9f374 None None] MFA Rules not processed for user `eed2ae18eb944593b93d80372d671e88`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:56:26.892715 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-c2140f65-c325-4644-bcd8-23f93be9f374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:56:27.070934 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bdca35-db21-43b1-9e79-356c8c54d388 service neutron] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:56:27.071570 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 763/1560] 10.222.0.15 () {58 vars in 958 bytes} [Sun Sep 18 00:56:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:56:27.085321 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bdca35-db21-43b1-9e79-356c8c54d388 service neutron] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:56:27.092642 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a71873d-456b-45c8-9d46-76c54568ac48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59ffbd91d29d4939bf7137c10c138592', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:56:27.093560 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71873d-456b-45c8-9d46-76c54568ac48 admin admin] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:56:27.094002 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71873d-456b-45c8-9d46-76c54568ac48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:56:27.094440 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71873d-456b-45c8-9d46-76c54568ac48 admin admin] PATH_INFO: `/v3/projects` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:56:27.095259 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a71873d-456b-45c8-9d46-76c54568ac48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:56:27.097624 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a71873d-456b-45c8-9d46-76c54568ac48 admin admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:56:27.178743 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 798/1561] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Sep 18 00:56:27 2022] POST /identity/v3/projects => generated 379 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 18 00:56:27.183518 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2140f65-c325-4644-bcd8-23f93be9f374 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:56:27.196362 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2140f65-c325-4644-bcd8-23f93be9f374 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:56:27.304373 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c324fd4-be34-450b-8f1a-8116d99667b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59ffbd91d29d4939bf7137c10c138592', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:56:27.305010 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c324fd4-be34-450b-8f1a-8116d99667b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:56:27.305491 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c324fd4-be34-450b-8f1a-8116d99667b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:56:27.305844 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c324fd4-be34-450b-8f1a-8116d99667b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:56:27.306565 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c324fd4-be34-450b-8f1a-8116d99667b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:56:27.308959 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c324fd4-be34-450b-8f1a-8116d99667b5 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:56:27.348267 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 764/1562] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Sep 18 00:56:27 2022] POST /identity/v3/users => generated 296 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 00:56:27.352326 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a71873d-456b-45c8-9d46-76c54568ac48 admin admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:56:27.369391 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a71873d-456b-45c8-9d46-76c54568ac48 admin admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:56:27.377674 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ea3db-f0ca-405f-9578-9d0a65671c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59ffbd91d29d4939bf7137c10c138592', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:56:27.378683 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ea3db-f0ca-405f-9578-9d0a65671c7e admin admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:56:27.379066 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ea3db-f0ca-405f-9578-9d0a65671c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:56:27.379429 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ea3db-f0ca-405f-9578-9d0a65671c7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:56:27.380287 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023ea3db-f0ca-405f-9578-9d0a65671c7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:56:27.382073 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023ea3db-f0ca-405f-9578-9d0a65671c7e admin admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:56:27.402440 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 799/1563] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Sep 18 00:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 00:56:27.406860 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c324fd4-be34-450b-8f1a-8116d99667b5 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:56:27.419578 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c324fd4-be34-450b-8f1a-8116d99667b5 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:56:27.433968 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae773ec-993b-4052-bd78-716bf087f774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59ffbd91d29d4939bf7137c10c138592', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:56:27.434807 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae773ec-993b-4052-bd78-716bf087f774 admin admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:56:27.436188 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae773ec-993b-4052-bd78-716bf087f774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:56:27.436526 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae773ec-993b-4052-bd78-716bf087f774 admin admin] PATH_INFO: `/v3/projects/e9260f21638d4091a9f4c38b9816910c/users/e37eefd5388044c2a1634542c4442146/roles/591d4711dc204cf98003c8b7d7558506` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:56:27.441244 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:56:27.463513 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae773ec-993b-4052-bd78-716bf087f774 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9260f21638d4091a9f4c38b9816910c, user_id=e37eefd5388044c2a1634542c4442146, role_id=591d4711dc204cf98003c8b7d7558506)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:56:27.467241 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae773ec-993b-4052-bd78-716bf087f774 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:56:27.496538 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 765/1564] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Sep 18 00:56:27 2022] PUT /identity/v3/projects/e9260f21638d4091a9f4c38b9816910c/users/e37eefd5388044c2a1634542c4442146/roles/591d4711dc204cf98003c8b7d7558506 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 00:56:27.498107 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ea3db-f0ca-405f-9578-9d0a65671c7e admin admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:56:27.515902 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ea3db-f0ca-405f-9578-9d0a65671c7e admin admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:56:27.643043 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8174e8-91b5-4e9d-9f34-be20479d6c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59ffbd91d29d4939bf7137c10c138592', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:56:27.644181 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8174e8-91b5-4e9d-9f34-be20479d6c00 admin admin] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:56:27.644694 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8174e8-91b5-4e9d-9f34-be20479d6c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:56:27.645183 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8174e8-91b5-4e9d-9f34-be20479d6c00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:56:27.646746 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8174e8-91b5-4e9d-9f34-be20479d6c00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:56:27.650509 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8174e8-91b5-4e9d-9f34-be20479d6c00 admin admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:56:27.691940 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 800/1565] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Sep 18 00:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 00:56:27.701326 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae773ec-993b-4052-bd78-716bf087f774 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:56:27.733173 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae773ec-993b-4052-bd78-716bf087f774 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:56:27.738991 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7451eae2-6a55-4692-9fa8-fb2a2c355c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59ffbd91d29d4939bf7137c10c138592', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:56:27.739708 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451eae2-6a55-4692-9fa8-fb2a2c355c7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:56:27.740039 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451eae2-6a55-4692-9fa8-fb2a2c355c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:56:27.740308 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451eae2-6a55-4692-9fa8-fb2a2c355c7e admin admin] PATH_INFO: `/v3/projects/e9260f21638d4091a9f4c38b9816910c/users/e37eefd5388044c2a1634542c4442146/roles/591d4711dc204cf98003c8b7d7558506` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:56:27.743479 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7451eae2-6a55-4692-9fa8-fb2a2c355c7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9260f21638d4091a9f4c38b9816910c, user_id=e37eefd5388044c2a1634542c4442146, role_id=591d4711dc204cf98003c8b7d7558506)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:56:27.749499 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7451eae2-6a55-4692-9fa8-fb2a2c355c7e admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:56:27.769177 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 766/1566] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Sep 18 00:56:27 2022] PUT /identity/v3/projects/e9260f21638d4091a9f4c38b9816910c/users/e37eefd5388044c2a1634542c4442146/roles/591d4711dc204cf98003c8b7d7558506 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 00:56:28.134116 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a0a5aa-9b05-470a-bd37-1bf815771a24 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:56:28.135169 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a0a5aa-9b05-470a-bd37-1bf815771a24 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:56:28.135279 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a0a5aa-9b05-470a-bd37-1bf815771a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:56:28.184452 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-60a0a5aa-9b05-470a-bd37-1bf815771a24 None None] MFA Rules not processed for user `77466ec3b67a48c0b4435f6390561881`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:56:28.185995 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-60a0a5aa-9b05-470a-bd37-1bf815771a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:56:28.260482 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:56:28.328356 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 801/1567] 10.222.0.15 () {58 vars in 958 bytes} [Sun Sep 18 00:56:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:56:28.333188 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7451eae2-6a55-4692-9fa8-fb2a2c355c7e admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:56:28.492228 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7451eae2-6a55-4692-9fa8-fb2a2c355c7e admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:56:28.501484 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d072834-4fca-4bd2-a764-31940c540b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59ffbd91d29d4939bf7137c10c138592', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:56:28.502504 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d072834-4fca-4bd2-a764-31940c540b14 admin admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:56:28.503009 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d072834-4fca-4bd2-a764-31940c540b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:56:28.503441 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d072834-4fca-4bd2-a764-31940c540b14 admin admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:56:28.505359 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d072834-4fca-4bd2-a764-31940c540b14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:56:28.508269 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d072834-4fca-4bd2-a764-31940c540b14 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:56:28.566350 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 767/1568] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Sep 18 00:56:28 2022] POST /identity/v3/projects => generated 385 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 00:56:28.569800 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a0a5aa-9b05-470a-bd37-1bf815771a24 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:56:28.584813 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a0a5aa-9b05-470a-bd37-1bf815771a24 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:56:28.664872 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b8ab6a-75a2-45dd-aef1-f2407e660eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59ffbd91d29d4939bf7137c10c138592', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:56:28.666785 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8ab6a-75a2-45dd-aef1-f2407e660eb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:56:28.667638 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8ab6a-75a2-45dd-aef1-f2407e660eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:56:28.668056 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8ab6a-75a2-45dd-aef1-f2407e660eb6 admin admin] PATH_INFO: `/v3/users` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:56:28.669342 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b8ab6a-75a2-45dd-aef1-f2407e660eb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:56:28.671617 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b8ab6a-75a2-45dd-aef1-f2407e660eb6 admin admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:56:28.701104 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 802/1569] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Sep 18 00:56:28 2022] POST /identity/v3/users => generated 299 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 18 00:56:28.705383 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d072834-4fca-4bd2-a764-31940c540b14 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:56:28.717586 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d072834-4fca-4bd2-a764-31940c540b14 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:56:28.728535 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29722b3-b1ba-4e8e-93b4-3705e9dcbef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59ffbd91d29d4939bf7137c10c138592', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:56:28.729191 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29722b3-b1ba-4e8e-93b4-3705e9dcbef7 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:56:28.729474 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29722b3-b1ba-4e8e-93b4-3705e9dcbef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:56:28.729747 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29722b3-b1ba-4e8e-93b4-3705e9dcbef7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:56:28.730397 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29722b3-b1ba-4e8e-93b4-3705e9dcbef7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:56:28.732154 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29722b3-b1ba-4e8e-93b4-3705e9dcbef7 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:56:28.746635 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 768/1570] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Sep 18 00:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 00:56:28.752131 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b8ab6a-75a2-45dd-aef1-f2407e660eb6 admin admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:56:28.766336 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b8ab6a-75a2-45dd-aef1-f2407e660eb6 admin admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:56:28.771825 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b576df-da91-42e2-88f8-38746da48a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59ffbd91d29d4939bf7137c10c138592', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:56:28.773659 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b576df-da91-42e2-88f8-38746da48a3c admin admin] REQUEST_METHOD: `PUT` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:56:28.773659 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b576df-da91-42e2-88f8-38746da48a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:56:28.773659 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b576df-da91-42e2-88f8-38746da48a3c admin admin] PATH_INFO: `/v3/projects/9560fca9fa3449eca61e544661336202/users/0932c6624dd4449c99d1ee161210f452/roles/591d4711dc204cf98003c8b7d7558506` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:56:28.793026 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b576df-da91-42e2-88f8-38746da48a3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9560fca9fa3449eca61e544661336202, user_id=0932c6624dd4449c99d1ee161210f452, role_id=591d4711dc204cf98003c8b7d7558506)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:56:28.800461 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b576df-da91-42e2-88f8-38746da48a3c admin admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:56:28.826097 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 803/1571] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Sep 18 00:56:28 2022] PUT /identity/v3/projects/9560fca9fa3449eca61e544661336202/users/0932c6624dd4449c99d1ee161210f452/roles/591d4711dc204cf98003c8b7d7558506 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 00:56:28.827382 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29722b3-b1ba-4e8e-93b4-3705e9dcbef7 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:56:28.838106 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29722b3-b1ba-4e8e-93b4-3705e9dcbef7 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:56:28.936712 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244f28a7-a8ef-4d00-ab6e-6a47fcb1d0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59ffbd91d29d4939bf7137c10c138592', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:56:28.937720 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f28a7-a8ef-4d00-ab6e-6a47fcb1d0d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:56:28.939102 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f28a7-a8ef-4d00-ab6e-6a47fcb1d0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:56:28.940076 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f28a7-a8ef-4d00-ab6e-6a47fcb1d0d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:56:28.941411 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244f28a7-a8ef-4d00-ab6e-6a47fcb1d0d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:56:28.945236 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244f28a7-a8ef-4d00-ab6e-6a47fcb1d0d3 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:56:28.964361 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 769/1572] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Sep 18 00:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 18 00:56:28.965729 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b576df-da91-42e2-88f8-38746da48a3c admin admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:56:28.979883 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b576df-da91-42e2-88f8-38746da48a3c admin admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:56:28.986657 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250bf59a-17ff-4a72-a741-2faa5ec5d9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59ffbd91d29d4939bf7137c10c138592', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:56:28.987661 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250bf59a-17ff-4a72-a741-2faa5ec5d9ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:56:28.988208 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250bf59a-17ff-4a72-a741-2faa5ec5d9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:56:28.988726 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250bf59a-17ff-4a72-a741-2faa5ec5d9ac admin admin] PATH_INFO: `/v3/projects/9560fca9fa3449eca61e544661336202/users/0932c6624dd4449c99d1ee161210f452/roles/591d4711dc204cf98003c8b7d7558506` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:56:28.993902 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250bf59a-17ff-4a72-a741-2faa5ec5d9ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=9560fca9fa3449eca61e544661336202, user_id=0932c6624dd4449c99d1ee161210f452, role_id=591d4711dc204cf98003c8b7d7558506)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:56:28.996997 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250bf59a-17ff-4a72-a741-2faa5ec5d9ac admin admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:56:29.019949 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 804/1573] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Sep 18 00:56:28 2022] PUT /identity/v3/projects/9560fca9fa3449eca61e544661336202/users/0932c6624dd4449c99d1ee161210f452/roles/591d4711dc204cf98003c8b7d7558506 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 00:56:33.932651 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae7b9e-f47b-40ca-8b59-90895722bcc4 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:56:33.933263 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae7b9e-f47b-40ca-8b59-90895722bcc4 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:56:33.933263 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae7b9e-f47b-40ca-8b59-90895722bcc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:56:33.994143 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-cfae7b9e-f47b-40ca-8b59-90895722bcc4 None None] MFA Rules not processed for user `e37eefd5388044c2a1634542c4442146`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:56:33.995370 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-cfae7b9e-f47b-40ca-8b59-90895722bcc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:56:34.087068 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:56:34.244116 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 770/1574] 10.222.0.15 () {58 vars in 958 bytes} [Sun Sep 18 00:56:33 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:56:34.259435 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250bf59a-17ff-4a72-a741-2faa5ec5d9ac admin admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:56:34.268214 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-250bf59a-17ff-4a72-a741-2faa5ec5d9ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:56:34.435779 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250bf59a-17ff-4a72-a741-2faa5ec5d9ac admin admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:56:34.443493 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b931399-16f7-42a8-9876-25760b937488 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292700152741419f9f9a945f7587769a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:56:34.444597 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b931399-16f7-42a8-9876-25760b937488 service glance] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:56:34.445437 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b931399-16f7-42a8-9876-25760b937488 service glance] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:56:34.445540 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b931399-16f7-42a8-9876-25760b937488 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:56:34.543220 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:56:34.595449 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b931399-16f7-42a8-9876-25760b937488 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:56:34.598110 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b931399-16f7-42a8-9876-25760b937488 service glance] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:56:34.619688 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 805/1575] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:56:34 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 00:56:35.595194 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3497378f-8254-443b-b12d-752bb42f030c None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:56:35.595658 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3497378f-8254-443b-b12d-752bb42f030c None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:56:35.596030 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3497378f-8254-443b-b12d-752bb42f030c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:56:35.644611 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-3497378f-8254-443b-b12d-752bb42f030c None None] MFA Rules not processed for user `0932c6624dd4449c99d1ee161210f452`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:56:35.646141 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-3497378f-8254-443b-b12d-752bb42f030c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:56:35.775581 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 771/1576] 10.222.0.15 () {58 vars in 958 bytes} [Sun Sep 18 00:56:35 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:56:35.788934 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b931399-16f7-42a8-9876-25760b937488 service glance] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:56:35.791992 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-7b931399-16f7-42a8-9876-25760b937488 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:56:35.806954 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b931399-16f7-42a8-9876-25760b937488 service glance] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:56:35.815619 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419deac1-0d19-4c65-98a0-2ca392c08857 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292700152741419f9f9a945f7587769a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:56:35.816274 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419deac1-0d19-4c65-98a0-2ca392c08857 service glance] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:56:35.817211 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419deac1-0d19-4c65-98a0-2ca392c08857 service glance] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:56:35.821116 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419deac1-0d19-4c65-98a0-2ca392c08857 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:56:35.897482 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419deac1-0d19-4c65-98a0-2ca392c08857 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:56:35.898922 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419deac1-0d19-4c65-98a0-2ca392c08857 service glance] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:56:35.909647 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 806/1577] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:56:35 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 00:56:36.151434 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b103ab-7cda-4ddb-9fc5-fc4cf10df086 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:56:36.151723 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b103ab-7cda-4ddb-9fc5-fc4cf10df086 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:56:36.153204 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b103ab-7cda-4ddb-9fc5-fc4cf10df086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:56:36.258580 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-09b103ab-7cda-4ddb-9fc5-fc4cf10df086 None None] MFA Rules not processed for user `9afbb5a9f364495ca55089dd6ddd7934`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:56:36.259928 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-09b103ab-7cda-4ddb-9fc5-fc4cf10df086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:56:36.382504 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 772/1578] 10.222.0.15 () {58 vars in 1009 bytes} [Sun Sep 18 00:56:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 00:56:36.427683 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0154bfc-4bb7-4776-8cba-65f4be025e1e None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:56:36.428112 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0154bfc-4bb7-4776-8cba-65f4be025e1e None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:56:36.428744 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0154bfc-4bb7-4776-8cba-65f4be025e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:56:36.458258 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-f0154bfc-4bb7-4776-8cba-65f4be025e1e None None] MFA Rules not processed for user `9afbb5a9f364495ca55089dd6ddd7934`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:56:36.459920 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-f0154bfc-4bb7-4776-8cba-65f4be025e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:56:36.471647 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 807/1579] 10.222.0.15 () {58 vars in 1009 bytes} [Sun Sep 18 00:56:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:56:36.542524 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b103ab-7cda-4ddb-9fc5-fc4cf10df086 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:56:36.545862 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-09b103ab-7cda-4ddb-9fc5-fc4cf10df086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:56:36.550972 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0154bfc-4bb7-4776-8cba-65f4be025e1e None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:56:36.553309 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-f0154bfc-4bb7-4776-8cba-65f4be025e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:56:36.579678 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:56:36.712554 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0154bfc-4bb7-4776-8cba-65f4be025e1e None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:56:36.729988 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea4f2b5-006c-45af-beca-7129765a4858 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0f16f1f2cb8475d9d5c752f56c4b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:56:36.731020 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4f2b5-006c-45af-beca-7129765a4858 service swift] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:56:36.731416 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4f2b5-006c-45af-beca-7129765a4858 service swift] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:56:36.731760 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4f2b5-006c-45af-beca-7129765a4858 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:56:36.735836 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b103ab-7cda-4ddb-9fc5-fc4cf10df086 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:56:36.745135 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea4f2b5-006c-45af-beca-7129765a4858 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:56:36.745943 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb6b31-e52d-4b99-977f-0872ec09edf6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0f16f1f2cb8475d9d5c752f56c4b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:56:36.747434 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea4f2b5-006c-45af-beca-7129765a4858 service swift] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:56:36.747988 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb6b31-e52d-4b99-977f-0872ec09edf6 service swift] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:56:36.748514 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb6b31-e52d-4b99-977f-0872ec09edf6 service swift] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:56:36.749097 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb6b31-e52d-4b99-977f-0872ec09edf6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:56:36.761738 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cb6b31-e52d-4b99-977f-0872ec09edf6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:56:36.765458 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cb6b31-e52d-4b99-977f-0872ec09edf6 service swift] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:56:36.766627 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 808/1580] 10.222.0.15 () {60 vars in 1384 bytes} [Sun Sep 18 00:56:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 18 00:56:36.779339 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 773/1581] 10.222.0.15 () {60 vars in 1384 bytes} [Sun Sep 18 00:56:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 18 00:56:46.755743 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=86 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:56:46.774940 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=30 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:56:49.242983 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ae3b2-218f-4a36-9100-7c2992f55c0e None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:56:49.243768 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ae3b2-218f-4a36-9100-7c2992f55c0e None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:56:49.244092 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ae3b2-218f-4a36-9100-7c2992f55c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:56:49.281787 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-590ae3b2-218f-4a36-9100-7c2992f55c0e None None] MFA Rules not processed for user `77466ec3b67a48c0b4435f6390561881`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:56:49.283611 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-590ae3b2-218f-4a36-9100-7c2992f55c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:56:49.293933 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 809/1582] 10.222.0.15 () {58 vars in 958 bytes} [Sun Sep 18 00:56:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:56:49.645972 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ed8ba-6e8e-4359-9769-1ed35c035d98 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:56:49.647289 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ed8ba-6e8e-4359-9769-1ed35c035d98 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:56:49.647761 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ed8ba-6e8e-4359-9769-1ed35c035d98 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:56:49.650495 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 774/1583] 10.222.0.15 () {54 vars in 965 bytes} [Sun Sep 18 00:56:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 18 00:56:49.657522 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be165fa-97a3-41d7-a233-300305e511e5 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:56:49.657812 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be165fa-97a3-41d7-a233-300305e511e5 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:56:49.658093 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be165fa-97a3-41d7-a233-300305e511e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:56:49.701998 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-4be165fa-97a3-41d7-a233-300305e511e5 None None] MFA Rules not processed for user `264c183fff8a49478eea4aceea73273e`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:56:49.703239 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-4be165fa-97a3-41d7-a233-300305e511e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:56:49.782459 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 810/1584] 10.222.0.15 () {58 vars in 1062 bytes} [Sun Sep 18 00:56:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 00:56:49.788571 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375d5df-d915-4307-a3e6-02fa96d94e48 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:56:49.788975 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375d5df-d915-4307-a3e6-02fa96d94e48 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:56:49.789345 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375d5df-d915-4307-a3e6-02fa96d94e48 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:56:49.790867 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 775/1585] 10.222.0.15 () {54 vars in 912 bytes} [Sun Sep 18 00:56:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:56:49.796964 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a469067c-618a-492f-a6bd-eb175edfccdb None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:56:49.797251 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a469067c-618a-492f-a6bd-eb175edfccdb None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:56:49.797527 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a469067c-618a-492f-a6bd-eb175edfccdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:56:49.828154 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-a469067c-618a-492f-a6bd-eb175edfccdb None None] MFA Rules not processed for user `264c183fff8a49478eea4aceea73273e`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:56:49.829892 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-a469067c-618a-492f-a6bd-eb175edfccdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:56:49.842441 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 811/1586] 10.222.0.15 () {58 vars in 1009 bytes} [Sun Sep 18 00:56:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 00:56:49.855802 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c375d5df-d915-4307-a3e6-02fa96d94e48 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:56:49.868553 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c375d5df-d915-4307-a3e6-02fa96d94e48 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:56:49.872367 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de9af9f-ba74-4fe1-8665-3fc36a578095 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292700152741419f9f9a945f7587769a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:56:49.873001 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9af9f-ba74-4fe1-8665-3fc36a578095 service glance] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:56:49.873286 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9af9f-ba74-4fe1-8665-3fc36a578095 service glance] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:56:49.873588 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9af9f-ba74-4fe1-8665-3fc36a578095 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:56:49.885464 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de9af9f-ba74-4fe1-8665-3fc36a578095 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:56:49.886930 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de9af9f-ba74-4fe1-8665-3fc36a578095 service glance] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:56:49.900239 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 776/1587] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:56:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 18 00:56:50.469182 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ceabe-c0fc-4edc-a269-307c4ae102db None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:56:50.469979 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ceabe-c0fc-4edc-a269-307c4ae102db None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:56:50.470420 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ceabe-c0fc-4edc-a269-307c4ae102db None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:56:50.473077 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 812/1588] 10.222.0.15 () {54 vars in 912 bytes} [Sun Sep 18 00:56:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:56:50.481862 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe6353-7d1b-4245-992a-ef7b89403f44 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:56:50.482356 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe6353-7d1b-4245-992a-ef7b89403f44 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:56:50.482842 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe6353-7d1b-4245-992a-ef7b89403f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:56:50.533100 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-befe6353-7d1b-4245-992a-ef7b89403f44 None None] MFA Rules not processed for user `9e46cfbc3b604788a833a81befaaab06`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:56:50.534402 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-befe6353-7d1b-4245-992a-ef7b89403f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:56:50.626870 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 777/1589] 10.222.0.15 () {58 vars in 1009 bytes} [Sun Sep 18 00:56:50 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:56:50.640844 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887ceabe-c0fc-4edc-a269-307c4ae102db None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:56:50.643052 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-887ceabe-c0fc-4edc-a269-307c4ae102db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:56:50.661201 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887ceabe-c0fc-4edc-a269-307c4ae102db None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:56:50.671807 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14afe843-6500-4f9e-a6e4-fecd0e20d822 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e46cfbc3b604788a833a81befaaab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:56:50.672616 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14afe843-6500-4f9e-a6e4-fecd0e20d822 service neutron] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:56:50.672973 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14afe843-6500-4f9e-a6e4-fecd0e20d822 service neutron] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:56:50.673316 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14afe843-6500-4f9e-a6e4-fecd0e20d822 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:56:50.685517 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14afe843-6500-4f9e-a6e4-fecd0e20d822 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:56:50.686990 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14afe843-6500-4f9e-a6e4-fecd0e20d822 service neutron] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:56:50.699380 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 813/1590] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:56:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 00:56:51.173284 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f34020-7e1a-4ce3-9cfe-318aca6ca1e1 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:56:51.174099 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f34020-7e1a-4ce3-9cfe-318aca6ca1e1 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:56:51.174099 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f34020-7e1a-4ce3-9cfe-318aca6ca1e1 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:56:51.175739 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 778/1591] 10.222.0.15 () {54 vars in 965 bytes} [Sun Sep 18 00:56:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:56:51.183666 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a0e04-4e39-4cdb-9ee0-78fd6726d496 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:56:51.184245 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a0e04-4e39-4cdb-9ee0-78fd6726d496 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:56:51.184598 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a0e04-4e39-4cdb-9ee0-78fd6726d496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:56:51.201160 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f34020-7e1a-4ce3-9cfe-318aca6ca1e1 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:56:51.208280 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-c72a0e04-4e39-4cdb-9ee0-78fd6726d496 None None] MFA Rules not processed for user `264c183fff8a49478eea4aceea73273e`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:56:51.209718 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-c72a0e04-4e39-4cdb-9ee0-78fd6726d496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:56:51.220729 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 814/1592] 10.222.0.15 () {58 vars in 1062 bytes} [Sun Sep 18 00:56:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:56:51.226783 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8650d-50f0-4711-ab21-d32245375b6c None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:56:51.227137 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8650d-50f0-4711-ab21-d32245375b6c None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:56:51.227429 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8650d-50f0-4711-ab21-d32245375b6c None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:56:51.229227 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 815/1593] 10.222.0.15 () {54 vars in 912 bytes} [Sun Sep 18 00:56:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 18 00:56:51.234551 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f63534-0076-463f-acf5-a0a1142b4da1 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:56:51.234835 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f63534-0076-463f-acf5-a0a1142b4da1 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:56:51.235116 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f63534-0076-463f-acf5-a0a1142b4da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:56:51.257965 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-46f63534-0076-463f-acf5-a0a1142b4da1 None None] MFA Rules not processed for user `264c183fff8a49478eea4aceea73273e`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:56:51.259378 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-46f63534-0076-463f-acf5-a0a1142b4da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:56:51.269535 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 816/1594] 10.222.0.15 () {58 vars in 1009 bytes} [Sun Sep 18 00:56:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 00:56:51.285959 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f63534-0076-463f-acf5-a0a1142b4da1 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:56:51.288017 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f34020-7e1a-4ce3-9cfe-318aca6ca1e1 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:56:51.294514 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98eecbe-ff4a-41bc-a751-df3de2102f9d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7239e730ee034affb6bdf27e106c49cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:56:51.295190 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98eecbe-ff4a-41bc-a751-df3de2102f9d service placement] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:56:51.295474 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98eecbe-ff4a-41bc-a751-df3de2102f9d service placement] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:56:51.295753 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98eecbe-ff4a-41bc-a751-df3de2102f9d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:56:51.296805 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f63534-0076-463f-acf5-a0a1142b4da1 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:56:51.302175 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-e98eecbe-ff4a-41bc-a751-df3de2102f9d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:56:51.303213 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd84d4c4-cf3a-4de1-97b9-00faa064dc67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e46cfbc3b604788a833a81befaaab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:56:51.303944 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84d4c4-cf3a-4de1-97b9-00faa064dc67 service neutron] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:56:51.304304 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84d4c4-cf3a-4de1-97b9-00faa064dc67 service neutron] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:56:51.304660 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84d4c4-cf3a-4de1-97b9-00faa064dc67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:56:51.316485 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98eecbe-ff4a-41bc-a751-df3de2102f9d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:56:51.318309 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd84d4c4-cf3a-4de1-97b9-00faa064dc67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:56:51.318681 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98eecbe-ff4a-41bc-a751-df3de2102f9d service placement] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:56:51.320207 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd84d4c4-cf3a-4de1-97b9-00faa064dc67 service neutron] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:56:51.333281 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 779/1595] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:56:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 18 00:56:51.334341 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 817/1596] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:56:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 18 00:56:53.497713 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34741a5b-e074-43a6-9d1a-d76db53df659 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:56:53.498309 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34741a5b-e074-43a6-9d1a-d76db53df659 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:56:53.498450 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34741a5b-e074-43a6-9d1a-d76db53df659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:56:53.525686 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-34741a5b-e074-43a6-9d1a-d76db53df659 None None] MFA Rules not processed for user `9afbb5a9f364495ca55089dd6ddd7934`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:56:53.527083 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-34741a5b-e074-43a6-9d1a-d76db53df659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:56:53.534819 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 780/1597] 10.222.0.15 () {58 vars in 1009 bytes} [Sun Sep 18 00:56:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:56:53.550219 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd84d4c4-cf3a-4de1-97b9-00faa064dc67 service neutron] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:56:53.581735 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd84d4c4-cf3a-4de1-97b9-00faa064dc67 service neutron] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:56:53.594197 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157cc733-4eab-4971-92d0-46d4269fefef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0f16f1f2cb8475d9d5c752f56c4b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:56:53.594831 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157cc733-4eab-4971-92d0-46d4269fefef service swift] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:56:53.595118 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157cc733-4eab-4971-92d0-46d4269fefef service swift] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:56:53.595394 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157cc733-4eab-4971-92d0-46d4269fefef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:56:53.605795 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157cc733-4eab-4971-92d0-46d4269fefef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:56:53.607464 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157cc733-4eab-4971-92d0-46d4269fefef service swift] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:56:53.634011 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 818/1598] 10.222.0.15 () {60 vars in 1384 bytes} [Sun Sep 18 00:56:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 18 00:56:55.096978 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7a8ae-f6f7-4b15-9e42-ee12692341d0 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:56:55.098941 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7a8ae-f6f7-4b15-9e42-ee12692341d0 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:56:55.108420 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7a8ae-f6f7-4b15-9e42-ee12692341d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:56:55.145929 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-cfb7a8ae-f6f7-4b15-9e42-ee12692341d0 None None] MFA Rules not processed for user `9e46cfbc3b604788a833a81befaaab06`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:56:55.147554 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-cfb7a8ae-f6f7-4b15-9e42-ee12692341d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:56:55.173602 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 781/1599] 10.222.0.50 () {58 vars in 1015 bytes} [Sun Sep 18 00:56:55 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:56:55.225150 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157cc733-4eab-4971-92d0-46d4269fefef service swift] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:56:55.244975 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157cc733-4eab-4971-92d0-46d4269fefef service swift] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:56:55.256245 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f30d5c-0c9e-48c8-a0e7-6c95b12bc1d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e46cfbc3b604788a833a81befaaab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:56:55.257672 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f30d5c-0c9e-48c8-a0e7-6c95b12bc1d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:56:55.258888 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f30d5c-0c9e-48c8-a0e7-6c95b12bc1d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:56:55.259528 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f30d5c-0c9e-48c8-a0e7-6c95b12bc1d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:56:55.300036 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f30d5c-0c9e-48c8-a0e7-6c95b12bc1d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:56:55.303296 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f30d5c-0c9e-48c8-a0e7-6c95b12bc1d3 service neutron] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:56:55.324966 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 819/1600] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:56:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 18 00:56:57.150214 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb3c8a-3daf-42df-b954-02aa7d6ebc0e None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:56:57.151590 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb3c8a-3daf-42df-b954-02aa7d6ebc0e None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:56:57.152072 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb3c8a-3daf-42df-b954-02aa7d6ebc0e None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:56:57.154878 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 782/1601] 10.222.0.15 () {54 vars in 921 bytes} [Sun Sep 18 00:56:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:56:57.168845 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e87f5-3081-46f3-8af4-25093ed5445d None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:56:57.170266 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e87f5-3081-46f3-8af4-25093ed5445d None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:56:57.170921 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e87f5-3081-46f3-8af4-25093ed5445d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:56:57.284844 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-733e87f5-3081-46f3-8af4-25093ed5445d None None] MFA Rules not processed for user `264c183fff8a49478eea4aceea73273e`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:56:57.305591 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-733e87f5-3081-46f3-8af4-25093ed5445d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:56:57.355622 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 820/1602] 10.222.0.15 () {58 vars in 1018 bytes} [Sun Sep 18 00:56:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:56:57.528608 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbb3c8a-3daf-42df-b954-02aa7d6ebc0e None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:56:57.585768 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbb3c8a-3daf-42df-b954-02aa7d6ebc0e None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:56:57.623450 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b97639-62b6-4ba9-a1b1-de7eddf7c186 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264c183fff8a49478eea4aceea73273e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:56:57.624455 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b97639-62b6-4ba9-a1b1-de7eddf7c186 service nova] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:56:57.625052 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b97639-62b6-4ba9-a1b1-de7eddf7c186 service nova] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:56:57.625538 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b97639-62b6-4ba9-a1b1-de7eddf7c186 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:56:57.651250 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b97639-62b6-4ba9-a1b1-de7eddf7c186 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:56:57.655649 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b97639-62b6-4ba9-a1b1-de7eddf7c186 service nova] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:56:57.678036 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 783/1603] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:56:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 00:57:07.258689 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=76 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:57:07.668571 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=79 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:57:19.358438 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df3856-6b69-4b16-ab03-592cb372b69c None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:57:19.359285 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df3856-6b69-4b16-ab03-592cb372b69c None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:57:19.359417 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df3856-6b69-4b16-ab03-592cb372b69c None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:57:19.362015 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 821/1604] 10.222.0.15 () {54 vars in 921 bytes} [Sun Sep 18 00:57:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:57:19.372561 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168605c-963d-4cac-8aae-764df6815e81 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:57:19.373247 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168605c-963d-4cac-8aae-764df6815e81 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:57:19.373598 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168605c-963d-4cac-8aae-764df6815e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:57:19.406472 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-0168605c-963d-4cac-8aae-764df6815e81 None None] MFA Rules not processed for user `264c183fff8a49478eea4aceea73273e`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:57:19.408990 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-0168605c-963d-4cac-8aae-764df6815e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:57:19.425893 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 784/1605] 10.222.0.15 () {58 vars in 1018 bytes} [Sun Sep 18 00:57:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:57:19.448916 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df3856-6b69-4b16-ab03-592cb372b69c None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:57:19.474018 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df3856-6b69-4b16-ab03-592cb372b69c None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:57:19.483802 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2d497c-a3c3-4a88-97d6-dbd97979c765 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264c183fff8a49478eea4aceea73273e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:57:19.484795 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d497c-a3c3-4a88-97d6-dbd97979c765 service nova] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:57:19.485286 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d497c-a3c3-4a88-97d6-dbd97979c765 service nova] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:57:19.485756 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d497c-a3c3-4a88-97d6-dbd97979c765 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:57:19.502768 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2d497c-a3c3-4a88-97d6-dbd97979c765 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:57:19.505713 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2d497c-a3c3-4a88-97d6-dbd97979c765 service nova] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:57:19.522306 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 822/1606] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:57:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 18 00:57:29.398821 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=3 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:57:29.515472 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=6 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:57:33.074659 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5328f8-8cea-47e2-afd8-af4c5cfe677d None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:57:33.075378 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5328f8-8cea-47e2-afd8-af4c5cfe677d None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:57:33.075378 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5328f8-8cea-47e2-afd8-af4c5cfe677d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:57:33.096573 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-2d5328f8-8cea-47e2-afd8-af4c5cfe677d None None] MFA Rules not processed for user `eed2ae18eb944593b93d80372d671e88`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:57:33.097810 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-2d5328f8-8cea-47e2-afd8-af4c5cfe677d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:57:33.105974 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 785/1607] 10.222.0.15 () {58 vars in 958 bytes} [Sun Sep 18 00:57:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:57:33.490655 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e790d9-7b96-4558-b56d-233bb8a996bc None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:57:33.491382 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e790d9-7b96-4558-b56d-233bb8a996bc None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:57:33.491382 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e790d9-7b96-4558-b56d-233bb8a996bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:57:33.520756 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-89e790d9-7b96-4558-b56d-233bb8a996bc None None] MFA Rules not processed for user `9e46cfbc3b604788a833a81befaaab06`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:57:33.522112 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-89e790d9-7b96-4558-b56d-233bb8a996bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:57:33.529431 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 823/1608] 10.222.0.15 () {58 vars in 1009 bytes} [Sun Sep 18 00:57:33 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:57:33.542365 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5328f8-8cea-47e2-afd8-af4c5cfe677d None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:57:33.552670 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5328f8-8cea-47e2-afd8-af4c5cfe677d None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:57:33.557098 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31959c8c-b0c3-48a6-84ed-babd21877d4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e46cfbc3b604788a833a81befaaab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:57:33.557734 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31959c8c-b0c3-48a6-84ed-babd21877d4c service neutron] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:57:33.558014 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31959c8c-b0c3-48a6-84ed-babd21877d4c service neutron] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:57:33.558558 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31959c8c-b0c3-48a6-84ed-babd21877d4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:57:33.571084 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31959c8c-b0c3-48a6-84ed-babd21877d4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:57:33.573019 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31959c8c-b0c3-48a6-84ed-babd21877d4c service neutron] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:57:33.584502 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 786/1609] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:57:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 00:57:43.514786 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=3 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:57:43.578278 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=9 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:57:49.822532 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e790d9-7b96-4558-b56d-233bb8a996bc None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:57:49.831796 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e790d9-7b96-4558-b56d-233bb8a996bc None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:57:49.835693 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ecc6f-a260-4a52-a652-0984c2209060 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e46cfbc3b604788a833a81befaaab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:57:49.836293 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ecc6f-a260-4a52-a652-0984c2209060 service neutron] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:57:49.836583 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ecc6f-a260-4a52-a652-0984c2209060 service neutron] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:57:49.836857 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ecc6f-a260-4a52-a652-0984c2209060 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:57:49.846718 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0ecc6f-a260-4a52-a652-0984c2209060 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:57:49.848207 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0ecc6f-a260-4a52-a652-0984c2209060 service neutron] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:57:49.859618 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 824/1610] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:57:49 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 00:57:54.994199 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e82f2-601d-4491-9bb0-91a7cb3a2a28 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:57:54.995132 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e82f2-601d-4491-9bb0-91a7cb3a2a28 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:57:54.995731 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e82f2-601d-4491-9bb0-91a7cb3a2a28 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:57:54.999527 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 787/1611] 10.222.0.15 () {54 vars in 921 bytes} [Sun Sep 18 00:57:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 00:57:55.017661 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a2b0e-9725-4fbc-b735-6887ceae98e9 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:57:55.018203 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a2b0e-9725-4fbc-b735-6887ceae98e9 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:57:55.018568 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a2b0e-9725-4fbc-b735-6887ceae98e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:57:55.050440 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-805a2b0e-9725-4fbc-b735-6887ceae98e9 None None] MFA Rules not processed for user `264c183fff8a49478eea4aceea73273e`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:57:55.064348 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-805a2b0e-9725-4fbc-b735-6887ceae98e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:57:55.083058 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 825/1612] 10.222.0.15 () {58 vars in 1018 bytes} [Sun Sep 18 00:57:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 00:57:55.099237 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25e82f2-601d-4491-9bb0-91a7cb3a2a28 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:57:55.126102 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25e82f2-601d-4491-9bb0-91a7cb3a2a28 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:57:55.137315 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93473f76-dcf2-435e-ad85-33fc6612929d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264c183fff8a49478eea4aceea73273e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:57:55.138617 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93473f76-dcf2-435e-ad85-33fc6612929d service nova] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:57:55.139251 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93473f76-dcf2-435e-ad85-33fc6612929d service nova] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:57:55.140126 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93473f76-dcf2-435e-ad85-33fc6612929d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:57:55.158857 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93473f76-dcf2-435e-ad85-33fc6612929d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:57:55.160892 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93473f76-dcf2-435e-ad85-33fc6612929d service nova] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:57:55.173325 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 788/1613] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 00:57:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 00:58:05.041566 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=9 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:58:05.168329 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=6 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:58:35.116697 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7eeb4-daa0-406b-98fb-273837539844 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:58:35.117303 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7eeb4-daa0-406b-98fb-273837539844 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:58:35.117303 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7eeb4-daa0-406b-98fb-273837539844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:58:35.137535 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-5ae7eeb4-daa0-406b-98fb-273837539844 None None] MFA Rules not processed for user `eed2ae18eb944593b93d80372d671e88`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:58:35.138882 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-5ae7eeb4-daa0-406b-98fb-273837539844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:58:35.146842 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 826/1614] 10.222.0.15 () {58 vars in 958 bytes} [Sun Sep 18 00:58:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:58:45.131261 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=3 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:58:53.461944 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc808f-3b84-4d91-a8a0-b4b75afc289c None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:58:53.462556 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc808f-3b84-4d91-a8a0-b4b75afc289c None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:58:53.462556 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc808f-3b84-4d91-a8a0-b4b75afc289c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:58:53.482617 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-78fc808f-3b84-4d91-a8a0-b4b75afc289c None None] MFA Rules not processed for user `9afbb5a9f364495ca55089dd6ddd7934`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:58:53.483845 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-78fc808f-3b84-4d91-a8a0-b4b75afc289c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:58:53.491513 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 789/1615] 10.222.0.15 () {58 vars in 1009 bytes} [Sun Sep 18 00:58:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:58:53.543614 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae7eeb4-daa0-406b-98fb-273837539844 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:58:53.555959 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae7eeb4-daa0-406b-98fb-273837539844 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:58:53.561040 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5397d3-47bb-4ca9-884b-57162d6766cd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0f16f1f2cb8475d9d5c752f56c4b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:58:53.561643 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5397d3-47bb-4ca9-884b-57162d6766cd service swift] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:58:53.562008 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5397d3-47bb-4ca9-884b-57162d6766cd service swift] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:58:53.562185 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5397d3-47bb-4ca9-884b-57162d6766cd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:58:53.570263 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5397d3-47bb-4ca9-884b-57162d6766cd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:58:53.571867 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5397d3-47bb-4ca9-884b-57162d6766cd service swift] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:58:53.581838 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 827/1616] 10.222.0.15 () {60 vars in 1384 bytes} [Sun Sep 18 00:58:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 18 00:58:58.981662 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56a54f-0394-4d5c-8037-9010cc1f6885 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:58:58.982273 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56a54f-0394-4d5c-8037-9010cc1f6885 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:58:58.982273 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56a54f-0394-4d5c-8037-9010cc1f6885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:58:59.001636 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-cd56a54f-0394-4d5c-8037-9010cc1f6885 None None] MFA Rules not processed for user `eed2ae18eb944593b93d80372d671e88`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:58:59.002838 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-cd56a54f-0394-4d5c-8037-9010cc1f6885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:58:59.010268 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 790/1617] 10.222.0.15 () {58 vars in 958 bytes} [Sun Sep 18 00:58:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 00:59:03.576926 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=6 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:59:08.996287 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=6 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:59:33.070777 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef401b-6f90-4213-aa30-a84532c1f1f2 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:59:33.071641 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef401b-6f90-4213-aa30-a84532c1f1f2 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:59:33.072324 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef401b-6f90-4213-aa30-a84532c1f1f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:59:33.095851 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-a6ef401b-6f90-4213-aa30-a84532c1f1f2 None None] MFA Rules not processed for user `9afbb5a9f364495ca55089dd6ddd7934`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:59:33.097181 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-a6ef401b-6f90-4213-aa30-a84532c1f1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:59:33.104844 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 828/1618] 10.222.0.15 () {58 vars in 967 bytes} [Sun Sep 18 00:59:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 00:59:33.119042 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd56a54f-0394-4d5c-8037-9010cc1f6885 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 00:59:33.133687 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd56a54f-0394-4d5c-8037-9010cc1f6885 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 00:59:33.138924 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b04b9dc-e145-4563-8f16-f3224a003754 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0f16f1f2cb8475d9d5c752f56c4b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 00:59:33.139556 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04b9dc-e145-4563-8f16-f3224a003754 service swift] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:59:33.139836 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04b9dc-e145-4563-8f16-f3224a003754 service swift] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:59:33.140141 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04b9dc-e145-4563-8f16-f3224a003754 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:59:33.150414 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b04b9dc-e145-4563-8f16-f3224a003754 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 00:59:33.153074 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b04b9dc-e145-4563-8f16-f3224a003754 service swift] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 00:59:33.162454 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 791/1619] 10.222.0.15 () {60 vars in 1384 bytes} [Sun Sep 18 00:59:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 18 00:59:43.090255 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=3 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:59:43.158651 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=6 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 00:59:55.403337 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc152a-da87-4101-9782-a1db0e3f9590 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 00:59:55.404171 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc152a-da87-4101-9782-a1db0e3f9590 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 00:59:55.404171 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc152a-da87-4101-9782-a1db0e3f9590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 00:59:55.427681 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-73dc152a-da87-4101-9782-a1db0e3f9590 None None] MFA Rules not processed for user `eed2ae18eb944593b93d80372d671e88`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 00:59:55.429136 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-73dc152a-da87-4101-9782-a1db0e3f9590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 00:59:55.436735 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 829/1620] 10.222.0.15 () {58 vars in 958 bytes} [Sun Sep 18 00:59:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 01:00:05.422972 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=3 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:00:43.061723 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b04b9dc-e145-4563-8f16-f3224a003754 service swift] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 01:00:43.072811 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b04b9dc-e145-4563-8f16-f3224a003754 service swift] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 01:00:43.077837 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9003069d-2267-44f0-8b7f-82a233176419 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7239e730ee034affb6bdf27e106c49cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 01:00:43.078972 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003069d-2267-44f0-8b7f-82a233176419 service placement] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 01:00:43.079282 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003069d-2267-44f0-8b7f-82a233176419 service placement] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 01:00:43.079553 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003069d-2267-44f0-8b7f-82a233176419 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 01:00:43.089141 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9003069d-2267-44f0-8b7f-82a233176419 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 01:00:43.090832 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9003069d-2267-44f0-8b7f-82a233176419 service placement] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 01:00:43.102028 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 792/1621] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 01:00:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 01:00:53.097692 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=6 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:01:00.380841 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a33ba-faf8-4966-9647-1241c1f2b973 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 01:01:00.381390 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a33ba-faf8-4966-9647-1241c1f2b973 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 01:01:00.381390 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a33ba-faf8-4966-9647-1241c1f2b973 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 01:01:00.382784 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 830/1622] 10.222.0.15 () {54 vars in 921 bytes} [Sun Sep 18 01:01:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 18 01:01:00.395597 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909272d4-be38-4f92-b58a-4a155cf43cf7 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 01:01:00.396149 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909272d4-be38-4f92-b58a-4a155cf43cf7 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 01:01:00.396325 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909272d4-be38-4f92-b58a-4a155cf43cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 01:01:00.418543 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-909272d4-be38-4f92-b58a-4a155cf43cf7 None None] MFA Rules not processed for user `7239e730ee034affb6bdf27e106c49cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 01:01:00.419760 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-909272d4-be38-4f92-b58a-4a155cf43cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 01:01:00.429386 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 793/1623] 10.222.0.15 () {58 vars in 1018 bytes} [Sun Sep 18 01:01:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 01:01:00.453126 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0a0124-95f0-4356-a46e-cd18316bb1c0 None None] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 01:01:00.453643 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0a0124-95f0-4356-a46e-cd18316bb1c0 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 01:01:00.454124 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0a0124-95f0-4356-a46e-cd18316bb1c0 None None] PATH_INFO: `/` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 01:01:00.456703 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 831/1624] 10.222.0.15 () {54 vars in 961 bytes} [Sun Sep 18 01:01:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 01:01:00.464378 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040324d-5003-49f2-8f91-16d349023aac None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 01:01:00.464699 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040324d-5003-49f2-8f91-16d349023aac None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 01:01:00.465723 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040324d-5003-49f2-8f91-16d349023aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 01:01:00.501022 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-c040324d-5003-49f2-8f91-16d349023aac None None] MFA Rules not processed for user `7239e730ee034affb6bdf27e106c49cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 01:01:00.502322 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-c040324d-5003-49f2-8f91-16d349023aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 01:01:00.511324 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 794/1625] 10.222.0.15 () {58 vars in 1058 bytes} [Sun Sep 18 01:01:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 18 01:01:00.519489 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0a0124-95f0-4356-a46e-cd18316bb1c0 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 01:01:00.535275 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0a0124-95f0-4356-a46e-cd18316bb1c0 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 01:01:00.542233 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a84389d-4786-469c-ac57-7a4a38ff4e98 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7239e730ee034affb6bdf27e106c49cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 01:01:00.542844 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84389d-4786-469c-ac57-7a4a38ff4e98 service placement] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 01:01:00.543123 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84389d-4786-469c-ac57-7a4a38ff4e98 service placement] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 01:01:00.543394 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84389d-4786-469c-ac57-7a4a38ff4e98 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 01:01:00.552748 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a84389d-4786-469c-ac57-7a4a38ff4e98 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 01:01:00.554495 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a84389d-4786-469c-ac57-7a4a38ff4e98 service placement] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 01:01:00.564657 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 832/1626] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 01:01:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 01:01:04.467320 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c040324d-5003-49f2-8f91-16d349023aac None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 01:01:04.548082 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c040324d-5003-49f2-8f91-16d349023aac None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 01:01:04.553495 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f7928e-3ae3-4bf2-8812-0c6f35fba348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59ffbd91d29d4939bf7137c10c138592', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 01:01:04.554316 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7928e-3ae3-4bf2-8812-0c6f35fba348 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 01:01:04.554697 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7928e-3ae3-4bf2-8812-0c6f35fba348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 01:01:04.555142 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7928e-3ae3-4bf2-8812-0c6f35fba348 admin admin] PATH_INFO: `/v3/users/eed2ae18eb944593b93d80372d671e88` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 01:01:04.557058 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f7928e-3ae3-4bf2-8812-0c6f35fba348 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eed2ae18eb944593b93d80372d671e88)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 01:01:04.558247 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: WARNING py.warnings [None req-a2f7928e-3ae3-4bf2-8812-0c6f35fba348 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 18 01:01:04.558247 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: warnings.warn(msg) Sep 18 01:01:04.558247 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: Sep 18 01:01:04.560202 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f7928e-3ae3-4bf2-8812-0c6f35fba348 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 01:01:04.627758 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-a2f7928e-3ae3-4bf2-8812-0c6f35fba348 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eed2ae18eb944593b93d80372d671e88'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 01:01:04.647534 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-a2f7928e-3ae3-4bf2-8812-0c6f35fba348 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eed2ae18eb944593b93d80372d671e88'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 01:01:04.655356 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-a2f7928e-3ae3-4bf2-8812-0c6f35fba348 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eed2ae18eb944593b93d80372d671e88'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 01:01:04.656187 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-a2f7928e-3ae3-4bf2-8812-0c6f35fba348 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eed2ae18eb944593b93d80372d671e88'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 01:01:04.668110 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-a2f7928e-3ae3-4bf2-8812-0c6f35fba348 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eed2ae18eb944593b93d80372d671e88'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 01:01:04.674969 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 795/1627] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Sep 18 01:01:04 2022] DELETE /identity/v3/users/eed2ae18eb944593b93d80372d671e88 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 01:01:04.865879 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a84389d-4786-469c-ac57-7a4a38ff4e98 service placement] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 01:01:04.877631 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a84389d-4786-469c-ac57-7a4a38ff4e98 service placement] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 01:01:04.944393 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737db234-810e-4b04-b1fb-839cefdcb733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59ffbd91d29d4939bf7137c10c138592', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 01:01:04.944948 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737db234-810e-4b04-b1fb-839cefdcb733 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 01:01:04.946335 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737db234-810e-4b04-b1fb-839cefdcb733 admin admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 01:01:04.946622 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737db234-810e-4b04-b1fb-839cefdcb733 admin admin] PATH_INFO: `/v3/projects/e2d6b887d368404b837b652b698e5f8b` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 01:01:04.947793 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737db234-810e-4b04-b1fb-839cefdcb733 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2d6b887d368404b837b652b698e5f8b)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 01:01:04.950515 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: WARNING py.warnings [None req-737db234-810e-4b04-b1fb-839cefdcb733 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 18 01:01:04.950515 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: warnings.warn(msg) Sep 18 01:01:04.950515 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: Sep 18 01:01:04.950515 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737db234-810e-4b04-b1fb-839cefdcb733 admin admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 01:01:05.012469 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.notifications [None req-737db234-810e-4b04-b1fb-839cefdcb733 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2d6b887d368404b837b652b698e5f8b', 'request_id': 'req-737db234-810e-4b04-b1fb-839cefdcb733'} {{(pid=81571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 01:01:05.021295 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.notifications [None req-737db234-810e-4b04-b1fb-839cefdcb733 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2d6b887d368404b837b652b698e5f8b', 'request_id': 'req-737db234-810e-4b04-b1fb-839cefdcb733'} {{(pid=81571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 01:01:05.028102 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.notifications [None req-737db234-810e-4b04-b1fb-839cefdcb733 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2d6b887d368404b837b652b698e5f8b', 'request_id': 'req-737db234-810e-4b04-b1fb-839cefdcb733'} {{(pid=81571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 01:01:05.047297 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.notifications [None req-737db234-810e-4b04-b1fb-839cefdcb733 admin admin] The token cache is being invalidate because project e2d6b887d368404b837b652b698e5f8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 01:01:05.047574 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.notifications [None req-737db234-810e-4b04-b1fb-839cefdcb733 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 01:01:05.048320 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.notifications [None req-737db234-810e-4b04-b1fb-839cefdcb733 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 01:01:05.050023 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 833/1628] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Sep 18 01:01:04 2022] DELETE /identity/v3/projects/e2d6b887d368404b837b652b698e5f8b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 01:01:05.054080 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f7928e-3ae3-4bf2-8812-0c6f35fba348 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 01:01:05.055491 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-a2f7928e-3ae3-4bf2-8812-0c6f35fba348 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 01:01:05.068337 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f7928e-3ae3-4bf2-8812-0c6f35fba348 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 01:01:05.125700 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d316d5e-58bc-4b94-b6c8-50c31970078c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59ffbd91d29d4939bf7137c10c138592', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 01:01:05.126345 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d316d5e-58bc-4b94-b6c8-50c31970078c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 01:01:05.126630 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d316d5e-58bc-4b94-b6c8-50c31970078c admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 01:01:05.126916 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d316d5e-58bc-4b94-b6c8-50c31970078c admin admin] PATH_INFO: `/v3/users/e37eefd5388044c2a1634542c4442146` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 01:01:05.128091 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d316d5e-58bc-4b94-b6c8-50c31970078c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e37eefd5388044c2a1634542c4442146)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 01:01:05.130035 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d316d5e-58bc-4b94-b6c8-50c31970078c admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 01:01:05.135775 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:01:05.189922 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-3d316d5e-58bc-4b94-b6c8-50c31970078c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e37eefd5388044c2a1634542c4442146'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 01:01:05.204664 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-3d316d5e-58bc-4b94-b6c8-50c31970078c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e37eefd5388044c2a1634542c4442146'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 01:01:05.213689 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-3d316d5e-58bc-4b94-b6c8-50c31970078c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e37eefd5388044c2a1634542c4442146'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 01:01:05.214355 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-3d316d5e-58bc-4b94-b6c8-50c31970078c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e37eefd5388044c2a1634542c4442146'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 01:01:05.223023 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-3d316d5e-58bc-4b94-b6c8-50c31970078c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e37eefd5388044c2a1634542c4442146'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 01:01:05.229593 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 796/1629] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Sep 18 01:01:05 2022] DELETE /identity/v3/users/e37eefd5388044c2a1634542c4442146 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 01:01:05.410583 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737db234-810e-4b04-b1fb-839cefdcb733 admin admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 01:01:05.412673 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-737db234-810e-4b04-b1fb-839cefdcb733 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 01:01:05.428043 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737db234-810e-4b04-b1fb-839cefdcb733 admin admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 01:01:05.488747 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c02b6-369a-44ac-a91b-5270f6b1a12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59ffbd91d29d4939bf7137c10c138592', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 01:01:05.489403 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c02b6-369a-44ac-a91b-5270f6b1a12c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 01:01:05.489692 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c02b6-369a-44ac-a91b-5270f6b1a12c admin admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 01:01:05.489972 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c02b6-369a-44ac-a91b-5270f6b1a12c admin admin] PATH_INFO: `/v3/projects/e9260f21638d4091a9f4c38b9816910c` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 01:01:05.491137 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c02b6-369a-44ac-a91b-5270f6b1a12c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9260f21638d4091a9f4c38b9816910c)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 01:01:05.493368 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c02b6-369a-44ac-a91b-5270f6b1a12c admin admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 01:01:05.514987 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:01:05.542967 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.notifications [None req-273c02b6-369a-44ac-a91b-5270f6b1a12c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9260f21638d4091a9f4c38b9816910c', 'request_id': 'req-273c02b6-369a-44ac-a91b-5270f6b1a12c'} {{(pid=81571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 01:01:05.550851 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.notifications [None req-273c02b6-369a-44ac-a91b-5270f6b1a12c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9260f21638d4091a9f4c38b9816910c', 'request_id': 'req-273c02b6-369a-44ac-a91b-5270f6b1a12c'} {{(pid=81571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 01:01:05.556409 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.notifications [None req-273c02b6-369a-44ac-a91b-5270f6b1a12c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9260f21638d4091a9f4c38b9816910c', 'request_id': 'req-273c02b6-369a-44ac-a91b-5270f6b1a12c'} {{(pid=81571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 01:01:05.567736 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.notifications [None req-273c02b6-369a-44ac-a91b-5270f6b1a12c admin admin] The token cache is being invalidate because project e9260f21638d4091a9f4c38b9816910c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81571) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 01:01:05.568061 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.notifications [None req-273c02b6-369a-44ac-a91b-5270f6b1a12c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 01:01:05.568712 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.notifications [None req-273c02b6-369a-44ac-a91b-5270f6b1a12c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 01:01:05.570207 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 834/1630] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Sep 18 01:01:05 2022] DELETE /identity/v3/projects/e9260f21638d4091a9f4c38b9816910c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 01:01:15.225834 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:01:15.564916 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:01:46.369620 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d316d5e-58bc-4b94-b6c8-50c31970078c admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 01:01:46.371474 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-3d316d5e-58bc-4b94-b6c8-50c31970078c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 01:01:46.456745 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d316d5e-58bc-4b94-b6c8-50c31970078c admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 01:01:46.535275 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613487f9-e580-4eec-8c26-86ad43516901 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264c183fff8a49478eea4aceea73273e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 01:01:46.535825 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613487f9-e580-4eec-8c26-86ad43516901 service nova] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 01:01:46.536183 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613487f9-e580-4eec-8c26-86ad43516901 service nova] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 01:01:46.536410 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613487f9-e580-4eec-8c26-86ad43516901 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 01:01:46.539423 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-613487f9-e580-4eec-8c26-86ad43516901 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 01:01:46.636536 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613487f9-e580-4eec-8c26-86ad43516901 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 01:01:46.638711 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613487f9-e580-4eec-8c26-86ad43516901 service nova] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 01:01:46.651099 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 797/1631] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 01:01:46 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 01:01:48.583932 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c02b6-369a-44ac-a91b-5270f6b1a12c admin admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 01:01:48.586574 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-273c02b6-369a-44ac-a91b-5270f6b1a12c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 01:01:48.655754 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c02b6-369a-44ac-a91b-5270f6b1a12c admin admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 01:01:48.660173 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cde4f7-52f8-41f6-afa6-3e7e09db475f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbec16b81004ad3b4563ccc83d85c69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 01:01:48.661226 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cde4f7-52f8-41f6-afa6-3e7e09db475f service cinder] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 01:01:48.661520 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cde4f7-52f8-41f6-afa6-3e7e09db475f service cinder] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 01:01:48.661803 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cde4f7-52f8-41f6-afa6-3e7e09db475f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 01:01:48.664074 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-e7cde4f7-52f8-41f6-afa6-3e7e09db475f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 01:01:48.680390 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cde4f7-52f8-41f6-afa6-3e7e09db475f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 01:01:48.680945 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cde4f7-52f8-41f6-afa6-3e7e09db475f service cinder] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 01:01:48.697256 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 835/1632] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 01:01:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 01:01:55.048435 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ad8b5-38a8-4c5b-be2a-54764bbbde21 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 01:01:55.048969 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ad8b5-38a8-4c5b-be2a-54764bbbde21 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 01:01:55.048969 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ad8b5-38a8-4c5b-be2a-54764bbbde21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 01:01:55.068970 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-3b6ad8b5-38a8-4c5b-be2a-54764bbbde21 None None] MFA Rules not processed for user `9afbb5a9f364495ca55089dd6ddd7934`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 01:01:55.070188 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-3b6ad8b5-38a8-4c5b-be2a-54764bbbde21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 01:01:55.099962 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:01:55.126059 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 798/1633] 10.222.0.15 () {58 vars in 967 bytes} [Sun Sep 18 01:01:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 01:01:55.172910 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cde4f7-52f8-41f6-afa6-3e7e09db475f service cinder] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 01:01:55.174715 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-e7cde4f7-52f8-41f6-afa6-3e7e09db475f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 01:01:55.248234 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cde4f7-52f8-41f6-afa6-3e7e09db475f service cinder] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 01:01:55.254618 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a9e10c-38e6-49d9-9e2b-bbc839affc5b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0f16f1f2cb8475d9d5c752f56c4b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 01:01:55.255265 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a9e10c-38e6-49d9-9e2b-bbc839affc5b service swift] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 01:01:55.255549 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a9e10c-38e6-49d9-9e2b-bbc839affc5b service swift] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 01:01:55.255822 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a9e10c-38e6-49d9-9e2b-bbc839affc5b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 01:01:55.265000 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a9e10c-38e6-49d9-9e2b-bbc839affc5b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 01:01:55.266664 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a9e10c-38e6-49d9-9e2b-bbc839affc5b service swift] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 01:01:55.275255 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 836/1634] 10.222.0.15 () {60 vars in 1384 bytes} [Sun Sep 18 01:01:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 18 01:01:55.799555 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f065cee-6d1f-431b-bac2-c2ea3912cf56 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 01:01:55.799853 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f065cee-6d1f-431b-bac2-c2ea3912cf56 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 01:01:55.800156 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f065cee-6d1f-431b-bac2-c2ea3912cf56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 01:01:55.819139 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-3f065cee-6d1f-431b-bac2-c2ea3912cf56 None None] MFA Rules not processed for user `9afbb5a9f364495ca55089dd6ddd7934`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 01:01:55.820478 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-3f065cee-6d1f-431b-bac2-c2ea3912cf56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 01:01:55.828253 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 799/1635] 10.222.0.15 () {58 vars in 1009 bytes} [Sun Sep 18 01:01:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 01:01:55.840324 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a9e10c-38e6-49d9-9e2b-bbc839affc5b service swift] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 01:01:55.851653 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a9e10c-38e6-49d9-9e2b-bbc839affc5b service swift] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 01:01:55.857681 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa465e80-3392-474c-9d1e-c096b7bea945 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0f16f1f2cb8475d9d5c752f56c4b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 01:01:55.858351 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa465e80-3392-474c-9d1e-c096b7bea945 service swift] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 01:01:55.858636 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa465e80-3392-474c-9d1e-c096b7bea945 service swift] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 01:01:55.858926 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa465e80-3392-474c-9d1e-c096b7bea945 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 01:01:55.867194 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa465e80-3392-474c-9d1e-c096b7bea945 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 01:01:55.868807 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa465e80-3392-474c-9d1e-c096b7bea945 service swift] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 01:01:55.878271 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 837/1636] 10.222.0.15 () {60 vars in 1384 bytes} [Sun Sep 18 01:01:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 18 01:02:04.540527 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35788a-8f7d-4b6d-825f-8313071b9e74 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 01:02:04.541040 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35788a-8f7d-4b6d-825f-8313071b9e74 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 01:02:04.541189 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35788a-8f7d-4b6d-825f-8313071b9e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 01:02:04.560958 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-9d35788a-8f7d-4b6d-825f-8313071b9e74 None None] MFA Rules not processed for user `77466ec3b67a48c0b4435f6390561881`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 01:02:04.562175 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-9d35788a-8f7d-4b6d-825f-8313071b9e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 01:02:04.571530 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 800/1637] 10.222.0.15 () {58 vars in 958 bytes} [Sun Sep 18 01:02:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 01:02:04.853222 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa465e80-3392-474c-9d1e-c096b7bea945 service swift] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 01:02:04.854634 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-fa465e80-3392-474c-9d1e-c096b7bea945 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 01:02:04.911411 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa465e80-3392-474c-9d1e-c096b7bea945 service swift] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 01:02:04.915358 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea19c8c1-d97c-4cf1-bd55-69c5b5014ace service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e46cfbc3b604788a833a81befaaab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 01:02:04.915992 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19c8c1-d97c-4cf1-bd55-69c5b5014ace service neutron] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 01:02:04.916277 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19c8c1-d97c-4cf1-bd55-69c5b5014ace service neutron] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 01:02:04.916552 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19c8c1-d97c-4cf1-bd55-69c5b5014ace service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 01:02:04.918769 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-ea19c8c1-d97c-4cf1-bd55-69c5b5014ace service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 01:02:04.927820 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea19c8c1-d97c-4cf1-bd55-69c5b5014ace service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 01:02:04.929260 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea19c8c1-d97c-4cf1-bd55-69c5b5014ace service neutron] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 01:02:04.937625 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 838/1638] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 01:02:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 01:02:05.267469 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35788a-8f7d-4b6d-825f-8313071b9e74 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 01:02:05.268900 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-9d35788a-8f7d-4b6d-825f-8313071b9e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 01:02:05.351797 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35788a-8f7d-4b6d-825f-8313071b9e74 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 01:02:05.357507 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e919f3-8748-4e93-b5ea-d5fbffd246c2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7239e730ee034affb6bdf27e106c49cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 01:02:05.358114 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e919f3-8748-4e93-b5ea-d5fbffd246c2 service placement] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 01:02:05.358399 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e919f3-8748-4e93-b5ea-d5fbffd246c2 service placement] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 01:02:05.358677 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e919f3-8748-4e93-b5ea-d5fbffd246c2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 01:02:05.360451 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-10e919f3-8748-4e93-b5ea-d5fbffd246c2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 01:02:05.371671 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e919f3-8748-4e93-b5ea-d5fbffd246c2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 01:02:05.373312 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e919f3-8748-4e93-b5ea-d5fbffd246c2 service placement] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 01:02:05.382965 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 801/1639] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 01:02:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 01:02:06.707999 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945bc99-ef68-4e37-a756-0c675aac1551 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 01:02:06.708582 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945bc99-ef68-4e37-a756-0c675aac1551 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 01:02:06.708582 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945bc99-ef68-4e37-a756-0c675aac1551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 01:02:06.731864 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-7945bc99-ef68-4e37-a756-0c675aac1551 None None] MFA Rules not processed for user `9afbb5a9f364495ca55089dd6ddd7934`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 01:02:06.733130 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-7945bc99-ef68-4e37-a756-0c675aac1551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 01:02:06.740533 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 839/1640] 10.222.0.15 () {58 vars in 1009 bytes} [Sun Sep 18 01:02:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 01:02:06.753119 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e919f3-8748-4e93-b5ea-d5fbffd246c2 service placement] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 01:02:06.764813 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e919f3-8748-4e93-b5ea-d5fbffd246c2 service placement] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 01:02:06.770066 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0769c4-2482-4771-bf7f-d7cb1ccbe3da service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0f16f1f2cb8475d9d5c752f56c4b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 01:02:06.770694 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0769c4-2482-4771-bf7f-d7cb1ccbe3da service swift] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 01:02:06.770973 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0769c4-2482-4771-bf7f-d7cb1ccbe3da service swift] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 01:02:06.771249 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0769c4-2482-4771-bf7f-d7cb1ccbe3da service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 01:02:06.781108 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0769c4-2482-4771-bf7f-d7cb1ccbe3da service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 01:02:06.782804 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0769c4-2482-4771-bf7f-d7cb1ccbe3da service swift] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 01:02:06.792738 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 802/1641] 10.222.0.15 () {60 vars in 1384 bytes} [Sun Sep 18 01:02:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 18 01:02:16.725358 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=93 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:02:16.789081 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=53 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:02:17.132618 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7945bc99-ef68-4e37-a756-0c675aac1551 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 01:02:17.142170 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7945bc99-ef68-4e37-a756-0c675aac1551 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 01:02:17.146313 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf4ce2d-e589-462f-baea-92221a5d7e63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e46cfbc3b604788a833a81befaaab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 01:02:17.146488 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf4ce2d-e589-462f-baea-92221a5d7e63 service neutron] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 01:02:17.146750 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf4ce2d-e589-462f-baea-92221a5d7e63 service neutron] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 01:02:17.147019 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf4ce2d-e589-462f-baea-92221a5d7e63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 01:02:17.148900 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-edf4ce2d-e589-462f-baea-92221a5d7e63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 01:02:17.159643 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf4ce2d-e589-462f-baea-92221a5d7e63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 01:02:17.161144 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf4ce2d-e589-462f-baea-92221a5d7e63 service neutron] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 01:02:17.170862 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 840/1642] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 01:02:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 01:02:22.461672 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0769c4-2482-4771-bf7f-d7cb1ccbe3da service swift] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 01:02:22.467163 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-ad0769c4-2482-4771-bf7f-d7cb1ccbe3da service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 01:02:22.490142 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0769c4-2482-4771-bf7f-d7cb1ccbe3da service swift] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 01:02:22.498882 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c09e8cc-ddeb-4a06-b06e-be9d6baa596e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264c183fff8a49478eea4aceea73273e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 01:02:22.500181 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09e8cc-ddeb-4a06-b06e-be9d6baa596e service nova] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 01:02:22.500659 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09e8cc-ddeb-4a06-b06e-be9d6baa596e service nova] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 01:02:22.501026 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09e8cc-ddeb-4a06-b06e-be9d6baa596e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 01:02:22.503260 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-4c09e8cc-ddeb-4a06-b06e-be9d6baa596e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 01:02:22.520349 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c09e8cc-ddeb-4a06-b06e-be9d6baa596e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 01:02:22.522032 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c09e8cc-ddeb-4a06-b06e-be9d6baa596e service nova] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 01:02:22.535199 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 803/1643] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 01:02:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 01:02:27.166538 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=6 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:02:32.529595 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=6 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:02:37.401570 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf4ce2d-e589-462f-baea-92221a5d7e63 service neutron] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 01:02:37.416236 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf4ce2d-e589-462f-baea-92221a5d7e63 service neutron] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 01:02:37.428103 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c220a4a-e2b9-4adf-a119-b9ff325a01f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264c183fff8a49478eea4aceea73273e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 01:02:37.428944 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c220a4a-e2b9-4adf-a119-b9ff325a01f8 service nova] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 01:02:37.429306 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c220a4a-e2b9-4adf-a119-b9ff325a01f8 service nova] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 01:02:37.429658 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c220a4a-e2b9-4adf-a119-b9ff325a01f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 01:02:37.431551 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-5c220a4a-e2b9-4adf-a119-b9ff325a01f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 01:02:37.445502 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c220a4a-e2b9-4adf-a119-b9ff325a01f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 01:02:37.447241 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c220a4a-e2b9-4adf-a119-b9ff325a01f8 service nova] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 01:02:37.459934 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 841/1644] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 01:02:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 01:02:47.454318 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=6 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:04:45.463803 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c09e8cc-ddeb-4a06-b06e-be9d6baa596e service nova] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 01:04:45.573717 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c09e8cc-ddeb-4a06-b06e-be9d6baa596e service nova] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 01:04:45.580353 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ca3c6-f2bc-40bf-adb2-f3cf1bcfbf3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '264c183fff8a49478eea4aceea73273e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 01:04:45.581316 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ca3c6-f2bc-40bf-adb2-f3cf1bcfbf3b service nova] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 01:04:45.581793 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ca3c6-f2bc-40bf-adb2-f3cf1bcfbf3b service nova] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 01:04:45.582288 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ca3c6-f2bc-40bf-adb2-f3cf1bcfbf3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 01:04:45.584463 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-7b3ca3c6-f2bc-40bf-adb2-f3cf1bcfbf3b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 01:04:45.627811 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3ca3c6-f2bc-40bf-adb2-f3cf1bcfbf3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 01:04:45.630290 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3ca3c6-f2bc-40bf-adb2-f3cf1bcfbf3b service nova] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 01:04:45.646490 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 804/1645] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 01:04:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 01:04:54.677393 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d709e1-5849-4ea7-9ff4-b5b0e5c24c52 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 01:04:54.677873 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d709e1-5849-4ea7-9ff4-b5b0e5c24c52 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 01:04:54.677966 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d709e1-5849-4ea7-9ff4-b5b0e5c24c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 01:04:54.709260 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-b4d709e1-5849-4ea7-9ff4-b5b0e5c24c52 None None] MFA Rules not processed for user `9afbb5a9f364495ca55089dd6ddd7934`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 01:04:54.710461 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-b4d709e1-5849-4ea7-9ff4-b5b0e5c24c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 01:04:54.717598 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 842/1646] 10.222.0.15 () {58 vars in 967 bytes} [Sun Sep 18 01:04:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 01:04:54.759057 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ca3c6-f2bc-40bf-adb2-f3cf1bcfbf3b service nova] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 01:04:54.771084 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ca3c6-f2bc-40bf-adb2-f3cf1bcfbf3b service nova] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 01:04:54.776080 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a2acd-8bbc-41e5-a714-65a5c188d1e9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0f16f1f2cb8475d9d5c752f56c4b74d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 01:04:54.776685 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a2acd-8bbc-41e5-a714-65a5c188d1e9 service swift] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 01:04:54.776974 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a2acd-8bbc-41e5-a714-65a5c188d1e9 service swift] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 01:04:54.777253 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a2acd-8bbc-41e5-a714-65a5c188d1e9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 01:04:54.785424 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4a2acd-8bbc-41e5-a714-65a5c188d1e9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 01:04:54.787013 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4a2acd-8bbc-41e5-a714-65a5c188d1e9 service swift] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 01:04:54.795474 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 805/1647] 10.222.0.15 () {60 vars in 1384 bytes} [Sun Sep 18 01:04:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 18 01:04:55.160227 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d709e1-5849-4ea7-9ff4-b5b0e5c24c52 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 01:04:55.179877 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d709e1-5849-4ea7-9ff4-b5b0e5c24c52 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 01:04:55.183542 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5506fe-b06e-43a9-8496-beb76fe67629 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e46cfbc3b604788a833a81befaaab06', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 01:04:55.184185 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5506fe-b06e-43a9-8496-beb76fe67629 service neutron] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 01:04:55.184470 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5506fe-b06e-43a9-8496-beb76fe67629 service neutron] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 01:04:55.184743 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5506fe-b06e-43a9-8496-beb76fe67629 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 01:04:55.186550 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-dc5506fe-b06e-43a9-8496-beb76fe67629 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 01:04:55.271122 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5506fe-b06e-43a9-8496-beb76fe67629 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 01:04:55.272634 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5506fe-b06e-43a9-8496-beb76fe67629 service neutron] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 01:04:55.292171 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 843/1648] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 01:04:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 01:04:58.364922 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8ab952-3fa0-4e7e-bff2-3ff17cc03c89 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 01:04:58.365414 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8ab952-3fa0-4e7e-bff2-3ff17cc03c89 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 01:04:58.365645 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8ab952-3fa0-4e7e-bff2-3ff17cc03c89 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 01:04:58.367091 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 806/1649] 10.222.0.15 () {54 vars in 921 bytes} [Sun Sep 18 01:04:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 18 01:04:58.377270 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a0e33-37ad-49d7-9597-b3a02c3808a0 None None] REQUEST_METHOD: `POST` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 01:04:58.377810 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a0e33-37ad-49d7-9597-b3a02c3808a0 None None] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 01:04:58.377810 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a0e33-37ad-49d7-9597-b3a02c3808a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 01:04:58.458060 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.auth.core [None req-eb9a0e33-37ad-49d7-9597-b3a02c3808a0 None None] MFA Rules not processed for user `7239e730ee034affb6bdf27e106c49cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81571) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 18 01:04:58.459455 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-eb9a0e33-37ad-49d7-9597-b3a02c3808a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 01:04:58.479673 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 844/1650] 10.222.0.15 () {58 vars in 1018 bytes} [Sun Sep 18 01:04:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 18 01:04:58.490824 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8ab952-3fa0-4e7e-bff2-3ff17cc03c89 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 01:04:58.505182 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8ab952-3fa0-4e7e-bff2-3ff17cc03c89 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 01:04:58.511137 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a101df-19de-4045-ae89-59164a3073ba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7239e730ee034affb6bdf27e106c49cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 01:04:58.511692 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a101df-19de-4045-ae89-59164a3073ba service placement] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 01:04:58.512008 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a101df-19de-4045-ae89-59164a3073ba service placement] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 01:04:58.512289 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a101df-19de-4045-ae89-59164a3073ba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 01:04:58.521008 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a101df-19de-4045-ae89-59164a3073ba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 01:04:58.522610 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a101df-19de-4045-ae89-59164a3073ba service placement] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 01:04:58.533267 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 807/1651] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 01:04:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 01:05:01.598526 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a0e33-37ad-49d7-9597-b3a02c3808a0 None None] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 01:05:01.600208 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-eb9a0e33-37ad-49d7-9597-b3a02c3808a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 01:05:01.615664 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a0e33-37ad-49d7-9597-b3a02c3808a0 None None] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 01:05:01.624216 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139c42e7-05eb-4431-b994-fb3418071ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59ffbd91d29d4939bf7137c10c138592', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 01:05:01.625388 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c42e7-05eb-4431-b994-fb3418071ce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 01:05:01.625627 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c42e7-05eb-4431-b994-fb3418071ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 01:05:01.625905 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c42e7-05eb-4431-b994-fb3418071ce1 admin admin] PATH_INFO: `/v3/users/77466ec3b67a48c0b4435f6390561881` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 01:05:01.627063 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139c42e7-05eb-4431-b994-fb3418071ce1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77466ec3b67a48c0b4435f6390561881)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 01:05:01.629032 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139c42e7-05eb-4431-b994-fb3418071ce1 admin admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 01:05:01.683459 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.notifications [None req-139c42e7-05eb-4431-b994-fb3418071ce1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77466ec3b67a48c0b4435f6390561881'} {{(pid=81571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 01:05:01.685379 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:05:01.693848 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.notifications [None req-139c42e7-05eb-4431-b994-fb3418071ce1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77466ec3b67a48c0b4435f6390561881'} {{(pid=81571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 01:05:01.694568 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.notifications [None req-139c42e7-05eb-4431-b994-fb3418071ce1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77466ec3b67a48c0b4435f6390561881'} {{(pid=81571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 01:05:01.702733 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.notifications [None req-139c42e7-05eb-4431-b994-fb3418071ce1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77466ec3b67a48c0b4435f6390561881'} {{(pid=81571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 01:05:01.714879 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.notifications [None req-139c42e7-05eb-4431-b994-fb3418071ce1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77466ec3b67a48c0b4435f6390561881'} {{(pid=81571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 01:05:01.720892 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 845/1652] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Sep 18 01:05:01 2022] DELETE /identity/v3/users/77466ec3b67a48c0b4435f6390561881 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 01:05:01.903110 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a101df-19de-4045-ae89-59164a3073ba service placement] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 01:05:01.913876 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a101df-19de-4045-ae89-59164a3073ba service placement] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 01:05:01.971662 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ead608-7413-4edb-bd59-9faa0b4a0fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59ffbd91d29d4939bf7137c10c138592', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 01:05:01.972330 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ead608-7413-4edb-bd59-9faa0b4a0fd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 01:05:01.972612 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ead608-7413-4edb-bd59-9faa0b4a0fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 01:05:01.972887 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ead608-7413-4edb-bd59-9faa0b4a0fd9 admin admin] PATH_INFO: `/v3/projects/f70e8748a48b4f50a9c3201beabaaa11` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 01:05:01.974008 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ead608-7413-4edb-bd59-9faa0b4a0fd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f70e8748a48b4f50a9c3201beabaaa11)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 01:05:01.975937 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ead608-7413-4edb-bd59-9faa0b4a0fd9 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 01:05:02.023968 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-44ead608-7413-4edb-bd59-9faa0b4a0fd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f70e8748a48b4f50a9c3201beabaaa11', 'request_id': 'req-44ead608-7413-4edb-bd59-9faa0b4a0fd9'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 01:05:02.025988 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:05:02.032825 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-44ead608-7413-4edb-bd59-9faa0b4a0fd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f70e8748a48b4f50a9c3201beabaaa11', 'request_id': 'req-44ead608-7413-4edb-bd59-9faa0b4a0fd9'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 01:05:02.039144 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-44ead608-7413-4edb-bd59-9faa0b4a0fd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f70e8748a48b4f50a9c3201beabaaa11', 'request_id': 'req-44ead608-7413-4edb-bd59-9faa0b4a0fd9'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 01:05:02.050897 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-44ead608-7413-4edb-bd59-9faa0b4a0fd9 admin admin] The token cache is being invalidate because project f70e8748a48b4f50a9c3201beabaaa11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 01:05:02.051196 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-44ead608-7413-4edb-bd59-9faa0b4a0fd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 01:05:02.051943 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-44ead608-7413-4edb-bd59-9faa0b4a0fd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 01:05:02.053449 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 808/1653] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Sep 18 01:05:01 2022] DELETE /identity/v3/projects/f70e8748a48b4f50a9c3201beabaaa11 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 01:05:02.058162 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139c42e7-05eb-4431-b994-fb3418071ce1 admin admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 01:05:02.059686 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-139c42e7-05eb-4431-b994-fb3418071ce1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 01:05:02.073018 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139c42e7-05eb-4431-b994-fb3418071ce1 admin admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 01:05:02.129171 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf875a9-b758-408d-92ff-4810dc49b9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59ffbd91d29d4939bf7137c10c138592', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 01:05:02.129837 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf875a9-b758-408d-92ff-4810dc49b9fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 01:05:02.130121 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf875a9-b758-408d-92ff-4810dc49b9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 01:05:02.130403 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf875a9-b758-408d-92ff-4810dc49b9fa admin admin] PATH_INFO: `/v3/users/0932c6624dd4449c99d1ee161210f452` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 01:05:02.131524 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf875a9-b758-408d-92ff-4810dc49b9fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=0932c6624dd4449c99d1ee161210f452)` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 01:05:02.133484 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf875a9-b758-408d-92ff-4810dc49b9fa admin admin] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 01:05:02.182452 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.notifications [None req-bcf875a9-b758-408d-92ff-4810dc49b9fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0932c6624dd4449c99d1ee161210f452'} {{(pid=81571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 01:05:02.190496 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.notifications [None req-bcf875a9-b758-408d-92ff-4810dc49b9fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0932c6624dd4449c99d1ee161210f452'} {{(pid=81571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 01:05:02.191214 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.notifications [None req-bcf875a9-b758-408d-92ff-4810dc49b9fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0932c6624dd4449c99d1ee161210f452'} {{(pid=81571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 01:05:02.199731 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.notifications [None req-bcf875a9-b758-408d-92ff-4810dc49b9fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0932c6624dd4449c99d1ee161210f452'} {{(pid=81571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 01:05:02.216888 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.notifications [None req-bcf875a9-b758-408d-92ff-4810dc49b9fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0932c6624dd4449c99d1ee161210f452'} {{(pid=81571) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 01:05:02.223637 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 846/1654] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Sep 18 01:05:02 2022] DELETE /identity/v3/users/0932c6624dd4449c99d1ee161210f452 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 01:05:02.427297 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ead608-7413-4edb-bd59-9faa0b4a0fd9 admin admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 01:05:02.429144 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-44ead608-7413-4edb-bd59-9faa0b4a0fd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 01:05:02.447841 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ead608-7413-4edb-bd59-9faa0b4a0fd9 admin admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 01:05:02.518280 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d014f58b-0336-4dcb-bd29-65675b96c5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f8bf0607941426a8b8271be8b554394', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59ffbd91d29d4939bf7137c10c138592', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 01:05:02.518980 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d014f58b-0336-4dcb-bd29-65675b96c5ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 01:05:02.519247 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d014f58b-0336-4dcb-bd29-65675b96c5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 01:05:02.519526 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d014f58b-0336-4dcb-bd29-65675b96c5ef admin admin] PATH_INFO: `/v3/projects/9560fca9fa3449eca61e544661336202` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 01:05:02.520705 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d014f58b-0336-4dcb-bd29-65675b96c5ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=9560fca9fa3449eca61e544661336202)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 01:05:02.522701 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d014f58b-0336-4dcb-bd29-65675b96c5ef admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 01:05:02.574965 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-d014f58b-0336-4dcb-bd29-65675b96c5ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9560fca9fa3449eca61e544661336202', 'request_id': 'req-d014f58b-0336-4dcb-bd29-65675b96c5ef'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 01:05:02.583217 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-d014f58b-0336-4dcb-bd29-65675b96c5ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9560fca9fa3449eca61e544661336202', 'request_id': 'req-d014f58b-0336-4dcb-bd29-65675b96c5ef'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 01:05:02.590121 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-d014f58b-0336-4dcb-bd29-65675b96c5ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9560fca9fa3449eca61e544661336202', 'request_id': 'req-d014f58b-0336-4dcb-bd29-65675b96c5ef'} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 01:05:02.601302 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-d014f58b-0336-4dcb-bd29-65675b96c5ef admin admin] The token cache is being invalidate because project 9560fca9fa3449eca61e544661336202 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81572) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 18 01:05:02.601590 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-d014f58b-0336-4dcb-bd29-65675b96c5ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 01:05:02.603344 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG keystone.notifications [None req-d014f58b-0336-4dcb-bd29-65675b96c5ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81572) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 18 01:05:02.604875 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 809/1655] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Sep 18 01:05:02 2022] DELETE /identity/v3/projects/9560fca9fa3449eca61e544661336202 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 18 01:05:12.219436 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=65 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:05:12.598352 dv-osbrick-master-4-iscsi devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=57 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 18 01:05:47.917859 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf875a9-b758-408d-92ff-4810dc49b9fa admin admin] Authenticating user token {{(pid=81571) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 18 01:05:47.919794 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-bcf875a9-b758-408d-92ff-4810dc49b9fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 01:05:47.992868 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf875a9-b758-408d-92ff-4810dc49b9fa admin admin] Validating token access rules against request {{(pid=81571) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 18 01:05:48.058287 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4393ff3f-9d84-49bd-9c63-2620d6a66fb7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7239e730ee034affb6bdf27e106c49cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52ebde8fa3f84ede9ef575f7c0780798', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81571) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 18 01:05:48.058917 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393ff3f-9d84-49bd-9c63-2620d6a66fb7 service placement] REQUEST_METHOD: `GET` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 18 01:05:48.059205 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393ff3f-9d84-49bd-9c63-2620d6a66fb7 service placement] SCRIPT_NAME: `/identity` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 18 01:05:48.059487 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393ff3f-9d84-49bd-9c63-2620d6a66fb7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81571) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 18 01:05:48.061344 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.fernet_utils [None req-4393ff3f-9d84-49bd-9c63-2620d6a66fb7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81571) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 18 01:05:48.075249 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4393ff3f-9d84-49bd-9c63-2620d6a66fb7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 18 01:05:48.078174 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4393ff3f-9d84-49bd-9c63-2620d6a66fb7 service placement] RBAC: Authorization granted {{(pid=81571) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 18 01:05:48.089888 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: [pid: 81571|app: 0|req: 847/1656] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Sep 18 01:05:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 18 01:05:58.085126 dv-osbrick-master-4-iscsi devstack@keystone.service[81571]: DEBUG dbcounter [-] [81571] Writing DB stats keystone:SELECT=58 {{(pid=81571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}